-- Logs begin at Tue 2021-08-10 02:41:24 UTC, end at Tue 2021-08-10 03:58:07 UTC. -- Aug 10 03:17:50.690019 dv-cinder-782390-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 03:17:50.697754 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 03:17:50 2021] *** Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: nodename: dv-cinder-782390-8-iscsi Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: machine: x86_64 Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: clock source: unix Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: pcre jit disabled Aug 10 03:17:50.699849 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: detected number of CPU cores: 4 Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: current working directory: / Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: detected binary path: /usr/bin/uwsgi-core Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: your processes number limit is 47680 Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: your memory page size is 4096 bytes Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: detected max file descriptor number: 2048 Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: lock engine: pthread robust mutexes Aug 10 03:17:50.700393 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: thunder lock: enabled Aug 10 03:17:50.701565 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 03:17:50.701667 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 03:17:50.747464 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: Python main interpreter initialized at 0x55e72e63f9c0 Aug 10 03:17:50.747464 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: python threads support enabled Aug 10 03:17:50.747464 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: your server socket listen backlog is limited to 100 connections Aug 10 03:17:50.747464 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: your mercy for graceful operations on workers is 90 seconds Aug 10 03:17:50.747835 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 03:17:50.747913 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: *** Operational MODE: preforking *** Aug 10 03:17:50.748185 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: *** uWSGI is running in multiple interpreter mode *** Aug 10 03:17:50.748185 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: spawned uWSGI master process (pid: 73145) Aug 10 03:17:50.748407 dv-cinder-782390-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 10 03:17:50.750134 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: spawned uWSGI worker 1 (pid: 73155, cores: 1) Aug 10 03:17:50.750134 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: spawned uWSGI worker 2 (pid: 73156, cores: 1) Aug 10 03:17:50.750134 dv-cinder-782390-8-iscsi devstack@keystone.service[73145]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 03:17:55.799879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:17:55.799879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: from cryptography.utils import int_from_bytes Aug 10 03:17:55.800681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:17:55.800681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: from cryptography.utils import int_from_bytes Aug 10 03:17:55.804621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:17:55.804621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: from cryptography.utils import int_from_bytes Aug 10 03:17:55.811005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 03:17:55.811005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: from cryptography.utils import int_from_bytes Aug 10 03:17:55.852718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] command line args: [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ================================================================================ {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] admin_token = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] config_dir = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.862937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.863442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 03:17:55.863511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] config_source = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.863511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] debug = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.863619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 03:17:55.863682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.863973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] command line args: [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 03:17:55.863973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 03:17:55.864087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ================================================================================ {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 03:17:55.864228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] admin_token = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] config_dir = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] config_source = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_config_append = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] debug = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_dir = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.864940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_file = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_config_append = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_dir = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.865995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_file = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.866999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] publish_errors = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] standard_threads = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.867976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] publish_errors = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] use_journal = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] use_json = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] use_stderr = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] use_syslog = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.868971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] standard_threads = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] use_journal = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] use_json = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] use_stderr = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] use_syslog = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.869867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.869931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 03:17:55.870000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.870997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.871987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872695 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.872961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.873981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.874969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.875875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.876906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.877894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.878997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.879843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.880907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.881909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.882886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.883960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.884993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.external = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.885989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.password = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] auth.token = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.886936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.887984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.external = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.888854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.889782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.password = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] auth.token = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.890976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.891948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.892988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.893936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.894886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.895977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.896965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.897924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.898996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.899829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.900927 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.901986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.902931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.903993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.904907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.905698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.906913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.907925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.908023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.908133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.908264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.908370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.908469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.909971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.910933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.911980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.912964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.913902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.914946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.915898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.916996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.917882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.918944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.919981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] role.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.920962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.921078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] role.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.921675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.921825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.921944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.922895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.923948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.924880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] role.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] role.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.925940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.926877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.927930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.928908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.929957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.930999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.931942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.932898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.connection = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.933933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.934973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.935905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.936779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.937414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.937536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.937653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.937768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.937897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:17:55.938672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.938672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.connection = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.939905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.940144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.940413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.940664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.940936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.941243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.941487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.941799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.942101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.942453 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.942706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.942994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.943236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 03:17:55.943407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 03:17:55.967761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.967996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.968758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.971149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.971390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.971648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.977566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:55.981265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.007188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.007420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.010401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.010686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.066029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.067068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.116585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.116830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.120032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.120306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.210699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.210944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.211912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.212122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.212405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.212644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.330392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.331000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.331460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.331697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.331926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.332154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.332412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.332632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.332850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.341180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.343857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.356502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.356707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.356792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.356869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.356943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73155) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.357983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73156) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 03:17:56.375985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.376215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 03:17:56.376555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.376693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.376777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 03:17:56.376852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 03:17:56.377018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 03:17:56.377533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.377877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.378099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.378358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.388696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.388972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.389240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.390119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.390204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.390204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.390399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.390578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.397699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.398808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.400945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.401226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.401504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.401787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.402330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.402960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.403953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.404252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.404535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.404802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.430311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.431634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.431908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.432188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.433250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.433534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.437588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.437867 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.438144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.438974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.439253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.439534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.445318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.445597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.446818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.447099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.450035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.450316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.450596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.450880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.451152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.451425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.451545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.451693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.451834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.451957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.452120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.452950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.453232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.453511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.453786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.454073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.470792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.471070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.472887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.473169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.475543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.477732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.479280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.479572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.481473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.481772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.485093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.487563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.488668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.490970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.492252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.492568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.492837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.493131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.493418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.493693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.494595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.494896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.495191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.495478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.495768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.496045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.513417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.513711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.513978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.514242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.515946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.516260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.516533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.516799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.522033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.523716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.523993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.524582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.526270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.526551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.527136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.527417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.527700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.527978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.528298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.529786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.530069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.530354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.530678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.530961 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.541390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.541673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.541962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.543528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.543823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.544109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.544190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.544432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.544527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.544753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.546870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.547175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.547464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.547761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.563118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.566122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.566327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.569384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.569660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.571345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.572700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.573001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.573281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.573568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.574427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.576061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.576367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.576651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.580842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.582380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.583960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.585585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.585702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.586032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.586319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.586597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.589244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.589542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.589823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.590205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.595848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.596135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.596441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.599215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.599502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.599796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.604164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73155) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.604469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.604844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.605129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.605412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.605684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.605955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.606237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.606514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.606787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.607064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.607336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.607596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73156) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 03:17:56.607687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.607852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73155) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.607943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.608296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.608600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.609428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.609715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.609993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.610277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.610556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.610844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.611116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.611390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.611659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.611920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73156) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 03:17:56.646401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e72e63f9c0 pid: 73155 (default app) Aug 10 03:17:56.649811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202a433-b288-43d4-aa26-7c21e37d1a9b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:17:56.650105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202a433-b288-43d4-aa26-7c21e37d1a9b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:17:56.650246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e72e63f9c0 pid: 73156 (default app) Aug 10 03:17:56.650386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202a433-b288-43d4-aa26-7c21e37d1a9b None None] PATH_INFO: `/v3` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:17:56.654566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 792 bytes} [Tue Aug 10 03:17:56 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:05.263986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:05.264552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:05.264552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:05.271074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:05 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:05.276817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:05.277202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:05.277371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:05.307888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:18:05.493649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG passlib.handlers.bcrypt [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73155) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 03:18:05.494085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG passlib.handlers.bcrypt [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73155) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 03:18:05.550001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:05.551608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:05.701660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:05.827991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:05.862192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG oslo_db.sqlalchemy.engines [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 03:18:05.990470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155d515-439c-42c9-a115-76652a9f2fd5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:05.994735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:05.995389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:05.995678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:05.995955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:06.004649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:06.057242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 03:18:06.057583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9fbb2-339c-4545-9df9-c38ff06f0d29 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:06.067717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:06.074604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:06.089220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0110-538c-4516-8a34-c2eaf748687a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:06.093600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:06.094738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:06.095020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:06.095293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:06.096789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] RBAC: Authorizing `identity:get_project(project_id=d847766cb8f7495b8c5c2a2d48910f07)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:06.149822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 03:18:06.150164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa7baf-7989-4bf8-8ee9-5fc886403682 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:06.154750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:06 2021] GET /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:08.228940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee48-1b4d-4e6f-ac05-dcc141b2e948 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:08.229441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee48-1b4d-4e6f-ac05-dcc141b2e948 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:08.229522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dee48-1b4d-4e6f-ac05-dcc141b2e948 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:08.234568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:08 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:08.240650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:08.241073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:08.241219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:08.259991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:08.261557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:08.269726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:08.293163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dee48-1b4d-4e6f-ac05-dcc141b2e948 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:08.305500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dee48-1b4d-4e6f-ac05-dcc141b2e948 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:08.309657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:08.310281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:08.310567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:08.310845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:08.318286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:08.320033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496389a-58d2-459e-a42d-3ded573c97cb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:08.328982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:08.334684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:08.343954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe69f6-11f8-45a1-a1c2-2ea71ad1bf06 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:08.348405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:08.349252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:08.349539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:08.349820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:08.351192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:08.353057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5360e4-066f-49f5-8c8f-77ddcbca8b53 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:08.354588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:08 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:10.501367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f76ba-f286-441c-888b-f673e743f95d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.501917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f76ba-f286-441c-888b-f673e743f95d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.501917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f76ba-f286-441c-888b-f673e743f95d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.503664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:10.510019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.510390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.510587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.528761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:10.530068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:10.530955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092ceb-9fb2-4b98-8069-aef932cbe55d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.531245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092ceb-9fb2-4b98-8069-aef932cbe55d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.531528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b092ceb-9fb2-4b98-8069-aef932cbe55d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.533260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 6/11] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:10.538074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 6/12] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:10.539045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.539337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.539617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.562280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.571274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95dcc2-b398-4b54-96df-aa305620213c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.575655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.576473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.576758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.577081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.581788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG passlib.handlers.bcrypt [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73156) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 03:18:10.582219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG passlib.handlers.bcrypt [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73156) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 03:18:10.590015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:10.596779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:10.597955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 7/13] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:10.604321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.613925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a931df7-ed75-4131-a6fb-69b28a97d68f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.618307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.618923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.619206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.619482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.620256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:10.620542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.622265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:10.622265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:10.622265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:10.623177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.628699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:10.630292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:10.636681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 8/14] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:10.642391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.651446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ebc7-bf4e-4008-8a66-67aae02076c1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.655816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.656657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.656938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.657210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.658391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.660178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.661816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 9/15] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:10.667154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.667517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 7/16] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:10.676817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51f1d-27ff-4517-bdf4-4a059ce4185c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.681097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.681791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.682075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.682349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.683478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.685136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.687184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 10/17] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:10.692727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.692982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.702010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef55f-94a0-4f39-9183-a4ae157db1f4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.702137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4a596-0cea-420d-abec-0fedc2d4a6c6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.706378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.706523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.706983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.707265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.707422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.707540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.707717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.708003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.708385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.domain.id=default, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:10.708704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.709821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:10.709821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:10.709821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:10.710930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.716058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.717489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 11/18] 10.222.0.21 () {56 vars in 1344 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.domain.id=default&role.id=cb3f52d5910b4e919a2580970bca865a => generated 233 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:10.717950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164dee3-190c-48ea-8b66-f5b01073ef56 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.728216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 8/19] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:10.735373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:10.748035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ac72-dfad-48e0-9863-c05ccb754b93 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:10.756764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:10.757758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:10.758265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:10.758563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:10.760178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:10.762004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b214583-e748-4960-bf21-7bd2bc7e9a9d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:10.763667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 12/20] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:13.035876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf6f7-78c6-4732-abd0-172034938530 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.036914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf6f7-78c6-4732-abd0-172034938530 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.037401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf6f7-78c6-4732-abd0-172034938530 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.039658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 9/21] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:13.045358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.046713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.047193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.077274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:13.078957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:13.097913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 13/22] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:13.145696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baf6f7-78c6-4732-abd0-172034938530 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.161384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baf6f7-78c6-4732-abd0-172034938530 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.166239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.167272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.167756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.168245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.188888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:13.196139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:13.197914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 10/23] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:13.204322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.213802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237acff7-d7e2-4139-a69d-f146ce84007a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.223328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.224346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.224832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.225304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.226252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:13.226754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:13.228632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:13.243709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 14/24] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:13.249982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.260753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9426d-6724-4c73-815b-a3107e4987e2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.268382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.269522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.270006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.270519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.272295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:13.274334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:13.276141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 11/25] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:13 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:13.282854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.293149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bdcad-6b4d-4e67-b118-bcd42705ec87 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.303279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.304391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.304876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.305350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.306776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:13.308751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b4274-89ec-483f-a46b-1d44ea55658e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:13.310627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 15/26] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:13.317088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.328962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e58d-872e-4404-8536-798a2ab3478c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.337783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.339003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.339511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.339993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] PATH_INFO: `/v3/domains/default/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.342281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f29509a114484baab53625cc3aa60565, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:13.344766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:13.344766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:13.344766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:13.347112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1fe45-cb6e-42ef-ae18-5ee3d3d02a6e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:13.430480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2915e-c3bf-4b9a-b851-3122a2923f94 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.430821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2915e-c3bf-4b9a-b851-3122a2923f94 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.431332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2915e-c3bf-4b9a-b851-3122a2923f94 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.433931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 16/27] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:13.439578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.439907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.440446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.465347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:13.466892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:13.479332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 17/28] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:13.499681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:13.509985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030badce-810e-4428-b2a5-d1e7d406fa04 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:13.519429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:13.520361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.520845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.521293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.522222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:13.523424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:13.523424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:13.523424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:13.524767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a109abe-16f0-47cd-a2c8-02ddfad9b4b2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:13.748227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 12/29] 10.222.0.21 () {58 vars in 1383 bytes} [Tue Aug 10 03:18:13 2021] PUT /identity/v3/domains/default/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:13.779447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69ece-71c8-444e-a5fb-e1a0b30372a8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.780470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69ece-71c8-444e-a5fb-e1a0b30372a8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.780470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69ece-71c8-444e-a5fb-e1a0b30372a8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.792229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 13/30] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:13 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:13.799235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:13.799696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:13.800127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:13.841375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:13.843401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:13.937623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 18/31] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:18:13 2021] POST /identity/v3/roles => generated 219 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:13.992711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 14/32] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:14.020993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0af3-e1d7-4597-a0ce-21ea7978948d None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.021508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0af3-e1d7-4597-a0ce-21ea7978948d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.021939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0af3-e1d7-4597-a0ce-21ea7978948d None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.023927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 19/33] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:14.025161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:14.031038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.031569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.032002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.057313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b2145-0ea6-4618-a5cd-44cd8d5230ad None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:14.068078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:14.069337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.069846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.070334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.072254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:14.074609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:14.092142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:14.093239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 20/34] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:14.095569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:14.115188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:14.116865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 15/35] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:14.123375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:14.137818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6d9cc-0794-458d-9989-63303da99215 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:14.145917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:14.146617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.146910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.147195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.147958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:14.148305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:14.149658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:14.149658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:14.149658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:14.150583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:14.173213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 21/36] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:14.175150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:14.179909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:14.187076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc661e90-324e-4597-b26f-5235278216a8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:14.192727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac50f-eb95-40e8-a03b-a405363585c0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:14.193510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:14.194190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.194480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.194766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.195538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:14.196672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:14.196672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:14.196672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:14.197581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356c64a-3927-4e09-a5fb-aa621f861e7f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:14.209221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:14.210197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.210702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.211185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.212095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:14.213380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:14.213380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:14.213380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:14.214944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad28133-e117-4d69-aa43-b4a0ae26b9bd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:14.349669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 16/37] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:18:14 2021] POST /identity/v3/roles => generated 225 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:14.410891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 22/38] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:18:14 2021] POST /identity/v3/projects => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:14.641931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616e3b-0b38-4215-a5c1-fa066d45f288 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.642697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616e3b-0b38-4215-a5c1-fa066d45f288 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.643208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616e3b-0b38-4215-a5c1-fa066d45f288 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.645601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 17/39] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:14.651665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad9b2-56c7-4997-a8a2-f5485329a514 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.651962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad9b2-56c7-4997-a8a2-f5485329a514 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.652285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad9b2-56c7-4997-a8a2-f5485329a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.676718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-663ad9b2-56c7-4997-a8a2-f5485329a514 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:14.677948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-663ad9b2-56c7-4997-a8a2-f5485329a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:14.742151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 23/40] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:14.766929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616e3b-0b38-4215-a5c1-fa066d45f288 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:14.783919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616e3b-0b38-4215-a5c1-fa066d45f288 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:14.788512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:14.789252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:14.789547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:14.789834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:14.790597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:14.792244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b420c49-b806-493c-a180-d0838fbc4053 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:14.877474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 18/41] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:18:14 2021] POST /identity/v3/roles => generated 223 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:15.030841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb62fb0-eb92-4715-a5d2-a67123e7056a None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:15.031130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb62fb0-eb92-4715-a5d2-a67123e7056a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:15.031325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb62fb0-eb92-4715-a5d2-a67123e7056a None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:15.033218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 24/42] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:15.039374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:15.039673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:15.039960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:15.058643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:15.059841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:15.067782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 19/43] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:15.091669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb62fb0-eb92-4715-a5d2-a67123e7056a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:15.104589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb62fb0-eb92-4715-a5d2-a67123e7056a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:15.109543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:15.110340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:15.110631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:15.110912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:15.112095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:15.113917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045b372-b283-46be-a0b2-f1d903dfcaf1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:15.115522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 25/44] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:15.121512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:15.130592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169035a-ebc6-4aa4-85bc-e322845901e4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:15.135157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:15.135802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:15.136087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:15.136392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:15.137100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:15.138106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:15.138106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:15.138106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:15.139302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75307a8-f1b2-4873-a407-25662695e179 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:15.285629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 20/45] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:18:15 2021] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:16.138359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af983f-2105-4a4a-9c6c-7bf00e845cff None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.138826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af983f-2105-4a4a-9c6c-7bf00e845cff None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.138940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af983f-2105-4a4a-9c6c-7bf00e845cff None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.141240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 26/46] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:16.147202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.147622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.147898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.165899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:16.167067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:16.221732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 21/47] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:16.245130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af983f-2105-4a4a-9c6c-7bf00e845cff None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:16.257585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af983f-2105-4a4a-9c6c-7bf00e845cff None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:16.262129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:16.262906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.263195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.263473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.274217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:16.280946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:16.282106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 27/48] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:16.288281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:16.297364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b076a-03d7-4ed8-a9e4-1e02196b4384 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:16.301831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:16.302576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.302868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.303145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.303889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:16.304216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:16.305247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:16.305247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:16.305247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:16.306156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:16.319306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 22/49] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:16.325433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:16.336413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603352f2-54c9-4138-8c3d-502460b8fec2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:16.340944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:16.341870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.342165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.342449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.343648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:16.345503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:16.347084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 28/50] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:16 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:16.352890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:16.362711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4454-68d7-491f-b675-d689054fef6f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:16.366981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:16.367766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.368056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.368374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.369560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:16.371304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004440e2-285f-4f9a-9c74-d953a2231f41 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:16.372901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 23/51] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:16.379264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:16.388948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95cdb6-1370-49b4-aeb6-7d0774cdb7b7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:16.393946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:16.394577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:16.394882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:16.395152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:16.395977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.domain.id=default, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:16.396336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:16.398186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4976c-beee-4e01-a04f-12d89842c1ab admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:16.403811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 29/52] 10.222.0.21 () {56 vars in 1344 bytes} [Tue Aug 10 03:18:16 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.domain.id=default&role.id=cb3f52d5910b4e919a2580970bca865a => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:17.393501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb088-40cf-4d04-8d34-ac9806d48c08 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:17.394004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb088-40cf-4d04-8d34-ac9806d48c08 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:17.394111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cb088-40cf-4d04-8d34-ac9806d48c08 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:17.395811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 24/53] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:17.402097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a576e8-a891-450e-a316-80684d69901e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:17.402503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a576e8-a891-450e-a316-80684d69901e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:17.402667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a576e8-a891-450e-a316-80684d69901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:17.420428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a1a576e8-a891-450e-a316-80684d69901e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:17.421601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a1a576e8-a891-450e-a316-80684d69901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:17.429115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 30/54] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:17.452553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb088-40cf-4d04-8d34-ac9806d48c08 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:17.464505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cb088-40cf-4d04-8d34-ac9806d48c08 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:17.469408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:17.470194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:17.470486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:17.470770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:17.471951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:17.473704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356e3e6-7ed0-4f95-863c-07d9ec87be59 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:17.475243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 25/55] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:17.480952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a576e8-a891-450e-a316-80684d69901e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:17.489715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a576e8-a891-450e-a316-80684d69901e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:17.494255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:17.494898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:17.495185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:17.495464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:17.496153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:17.498140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ad57a-962f-44c0-b417-0581f3957220 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:17.593793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 31/56] 10.222.0.21 () {60 vars in 1162 bytes} [Tue Aug 10 03:18:17 2021] POST /identity/v3/projects => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:19.671811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0ded-98aa-4c50-994b-e4a26994ebaf None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:19.672388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0ded-98aa-4c50-994b-e4a26994ebaf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:19.672504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0ded-98aa-4c50-994b-e4a26994ebaf None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:19.674270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 26/57] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:19.680037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:19.680465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:19.680644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:19.697916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:19.699099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:19.753591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 32/58] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:19.778347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0ded-98aa-4c50-994b-e4a26994ebaf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:19.790176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0ded-98aa-4c50-994b-e4a26994ebaf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:19.794356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:19.795124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:19.795412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:19.796181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:19.797360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:19.799044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68475c69-ff98-4507-bbf8-1320f4a44446 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:19.800625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 27/59] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:19.806204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:19.815493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937cee1-0b18-408f-b4a1-4109d6bc47f1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:19.819908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:19.820593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:19.820887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:19.821175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:19.821878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:19.822906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:19.822906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:19.822906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:19.824131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a596c8d-91cf-4f2b-85c4-bd8e2b5b3a0b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:19.928554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 33/60] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:19 2021] POST /identity/v3/users => generated 275 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:23.041832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eccc0-acfe-4c24-a8bd-f0d44d1b50e5 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.042685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eccc0-acfe-4c24-a8bd-f0d44d1b50e5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.043138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eccc0-acfe-4c24-a8bd-f0d44d1b50e5 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.045404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 28/61] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:23.051856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b095-4c79-4524-b267-486198356101 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.052339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b095-4c79-4524-b267-486198356101 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.052467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111b095-4c79-4524-b267-486198356101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.075932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7111b095-4c79-4524-b267-486198356101 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:23.077536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7111b095-4c79-4524-b267-486198356101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:23.090874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 34/62] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:23.128289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eccc0-acfe-4c24-a8bd-f0d44d1b50e5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.146387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eccc0-acfe-4c24-a8bd-f0d44d1b50e5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.152332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.153131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.153417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.153693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.172119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:23.179257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e4810bda-3b28-4707-8add-6f74fa61c4c6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:23.180677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 29/63] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:23.188116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b095-4c79-4524-b267-486198356101 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.201971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111b095-4c79-4524-b267-486198356101 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.218495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.219432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.219888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.220431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.221358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:23.221825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.223620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.239786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 35/64] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.244995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502aa2-be48-4383-8694-2e93a6d33a38 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.245563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502aa2-be48-4383-8694-2e93a6d33a38 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.246066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9502aa2-be48-4383-8694-2e93a6d33a38 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.248059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 30/65] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:23.250610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.253970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.254480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.254961 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.266597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c79d8-9a50-4219-98db-5ace860bc194 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.279073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.280842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.281348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.281827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.286595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:23.289323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:23.307231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 31/66] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:23.317030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.319523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.321283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 36/67] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.328061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.333215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.349937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd34e-b2c6-4f29-aa8a-e37f9f920959 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.352256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894160f-04fc-4d8d-9006-7d625070fd0b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.360171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.361070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.362049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.362763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.363233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.364186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.365238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.369980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.379237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.382303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.390992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:23.398146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:23.399596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 37/68] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:23.404237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 32/69] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:23.408826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.420259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39422eaa-1284-4091-a99b-de0cc78bfbec admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.421863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.431506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cee03-339a-45c3-99df-583c38ee9787 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.439538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.440460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.440754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.441039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.442897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.443696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.443988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.444292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.445102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.445529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:23.446061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.447213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.448094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.449318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 38/70] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.457783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.465218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 33/71] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.473278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.473455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e8adb-848d-499f-a9f2-513939fbc174 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.486185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06900-4930-41a2-826e-b92e4aa2f23c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.493095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.493992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.494986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.495875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.497342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:23.498126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.500861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.501898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.502338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.502990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9dc8d-d06e-4404-9597-2672b8eefa4d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.503409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.506811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.509055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.515651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 34/72] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.516071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 39/73] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=c0c74397018c4e10ae44afe610b4259b => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.522251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.523122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab390-bc7d-4551-9f43-d533a90da164 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.523419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab390-bc7d-4551-9f43-d533a90da164 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.523864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dab390-bc7d-4551-9f43-d533a90da164 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.526272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 40/74] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:23.533443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.533680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e53ad5-07eb-4248-bc46-a7213884a332 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.533966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.534257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.550497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.551179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.551468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.551751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.565353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:23.566504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:23.568275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.570119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.591182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 35/75] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:23.593885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.599232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 41/76] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:23.608363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c839a7-e90d-48a4-b000-13db87e732b8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.622240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.623137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.623431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.623757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.629309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.631496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.633702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 36/77] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.641008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.642118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.652113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba42b5-394e-48e7-bb22-028ff32398c7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.657473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.658283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.658574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.658857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.659344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e283-7919-4401-a2d5-7482912ff627 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.660136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.661893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.668313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 37/78] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.670080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.671084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.672004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.672620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.672921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.674057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:23.674601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.676819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc83b-1c68-4ae9-82e1-b8545e9ebdf9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.680358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb879e-5960-4ee3-81e0-0a5c7fe05d5b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.683596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 42/79] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.685426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2eef-41d3-40a9-90a4-02c89dba3d83 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.685620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.686567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2eef-41d3-40a9-90a4-02c89dba3d83 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.687033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.687262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2eef-41d3-40a9-90a4-02c89dba3d83 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.687359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.687586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.688368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.689835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 43/80] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:23.690417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96790330-0dc0-4e57-a629-fec7ae90f2aa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.696952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.697583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.698071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.727821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:23.729110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:23.739676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 44/81] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:23.767527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.777719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d1ea-f6ba-458e-a81b-6d24ba7b5c16 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.783190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.784050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.784426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.784705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.800435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 38/82] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/projects => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:23.813584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:23.821473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c90b-8555-4a78-af5c-22911f32549a None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.822285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c90b-8555-4a78-af5c-22911f32549a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.822790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9c90b-8555-4a78-af5c-22911f32549a None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.825131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 39/83] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:23.828849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:23.828849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 45/84] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:23.833208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.833815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.834361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.835551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.860283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d338f1-59f5-4378-a681-96e7365e214e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.865274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:23.866932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:23.933393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.934329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.934791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.935215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.936687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:23.937182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:23.938999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:23.951472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 40/85] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:23.957950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 46/86] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:23.972596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:23.983118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9fca5-b2b6-4c2b-978a-13856b309c36 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:23.994853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:23.995750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:23.996097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:23.996428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:23.997755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.000525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.002319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 41/87] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:23 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:24.008757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.009986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.021005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92128b5d-ca4b-494b-817d-a8e66aa9ac08 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.026424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f65b79-9ff5-44f5-a7de-8510f9124e05 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.031112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.031775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.032066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.032406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.037816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.039215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.040078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.040412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.042262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.044820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.052103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:24.056162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 47/88] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:24.064151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:24.065066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 42/89] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:24.065621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.074330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d46b59-e885-4c2d-abce-eec220c6e531 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.076401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.086031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.087187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.087696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.088216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.093849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.095821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2edd-1a0c-43bf-803f-2dbfa33cfd48 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.096018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.099005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 48/90] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:24.108348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.112489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.113726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.114827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.115336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.116737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:24.117252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.118205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d9818-1635-4785-8c35-86d96f4adffe admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.119404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.123489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.124224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.124618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.124902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.125782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:24.127017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.129047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.130569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 43/91] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:24.137715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.141080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 49/92] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=fccb1eae943b423e904443c48e4d0247 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:24.150531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb35c7-9f8c-4960-aa86-81630d2cb582 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.156073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.157453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.157961 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.158437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.160145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.162732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.164885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 44/93] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:24.173366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.184465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3a49-999c-465d-9293-8eb68a3ace27 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.189842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.190525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.190813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.191090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.199984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.202540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.213127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 50/94] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:24.219577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.240127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ece3f-002a-47f6-9e2b-5fd550398288 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.253017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.253915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.254208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.254494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] PATH_INFO: `/v3/projects/466137c38f41488b86ca3076c0fd289a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.255821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=466137c38f41488b86ca3076c0fd289a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.257946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56319a88-2758-4d60-9bbf-02c82ef858d9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.259967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 45/95] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/projects/466137c38f41488b86ca3076c0fd289a => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:24.267258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:24.278710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa049a2d-62dc-4fb4-b95f-8cc8a8755566 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:24.286516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:24.287233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:24.287526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:24.287811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:24.288673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=466137c38f41488b86ca3076c0fd289a, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:24.288992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:24.290955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b465b-fc1f-4310-a12f-8b40ccfc1923 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:24.300700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 51/96] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:24 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=466137c38f41488b86ca3076c0fd289a&role.id=c0c74397018c4e10ae44afe610b4259b => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.127916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec294726-5e37-44f6-af8f-b3615fd3f976 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.128448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec294726-5e37-44f6-af8f-b3615fd3f976 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.128526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec294726-5e37-44f6-af8f-b3615fd3f976 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.130602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 46/97] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:26.136722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56779-03e6-4fb9-afc5-821020fe15c4 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.137123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56779-03e6-4fb9-afc5-821020fe15c4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.137289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56779-03e6-4fb9-afc5-821020fe15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.164409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8af56779-03e6-4fb9-afc5-821020fe15c4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:26.165632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8af56779-03e6-4fb9-afc5-821020fe15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:26.179632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 52/98] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:26.216151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec294726-5e37-44f6-af8f-b3615fd3f976 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.232893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec294726-5e37-44f6-af8f-b3615fd3f976 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.242265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.243071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.243359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.243642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.260148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:26.266985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:26.268356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 47/99] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:26.268528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef0d0-431e-4394-814d-b95b4c74da57 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.268821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef0d0-431e-4394-814d-b95b4c74da57 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.269186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ef0d0-431e-4394-814d-b95b4c74da57 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.271001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 53/100] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:26.274252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.277161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.277674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.278136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.285281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce354b-cc0c-473b-8bb3-d588288ae667 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.289831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.290489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.290774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.291053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.292189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:26.292189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.293777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.308025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:26.309484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:26.309939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 48/101] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.317142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.327517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647866b-dd36-40a4-9725-ee4ffc1640dd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.332190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 54/102] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:26.332628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.333739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.334226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.334704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.336128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.338480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.340294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 49/103] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.348321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.359247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.366827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0cd53-89e6-4a9c-8729-92af1f22bdd8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.369640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c7581-1d7d-412f-a6a8-75f134d51c13 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.374581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.375602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.376091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.376609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.382466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.383345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.384052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.384523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.388736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:26.388945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.391795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.394049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 55/104] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.396622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:26.398019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 50/105] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:26.404411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.406027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.421411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8deae4-111c-4339-bd53-6c1fdf936db4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.422299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240ba1-4c58-4400-a214-b74343c9c070 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.428784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.429677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.429965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.430249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/333ab62b8878407e9fde1f4549e5372f/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.433125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.433794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.434081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.434358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.435105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:26.435413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.437079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.439264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcf143b1194ee4b2182082c9e5dcce, user_id=333ab62b8878407e9fde1f4549e5372f, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.440387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:26.440387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:26.440387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:26.442315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.456759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 51/106] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.463081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.473460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6e90-b0c5-430f-b88a-1c0a2ee56284 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.478345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.479314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.479599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.479879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.481171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.483675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.485872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 52/107] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.492086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.502524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7d374-5c4c-445d-a4f7-f3c9cb0dc31a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.507341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.508266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.508818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.509159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.518659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 56/108] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:26 2021] PUT /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/333ab62b8878407e9fde1f4549e5372f/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:18:26.519817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.522291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760df4ac-e9f6-458a-9e76-92bd14f7c7ce admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.524392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 53/109] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:26.535389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.579703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e77ac-3401-4c62-a86e-ebdfa5850f99 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.580315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e77ac-3401-4c62-a86e-ebdfa5850f99 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.580775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e77ac-3401-4c62-a86e-ebdfa5850f99 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.582712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 54/110] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:26.589119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.589695 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.590158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.605167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c745-4557-4e1c-a1d9-2b72b5cd8745 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.609092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:26.610447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.610763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:26.611358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.611643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.611923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.614531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcf143b1194ee4b2182082c9e5dcce, user_id=f29509a114484baab53625cc3aa60565, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.617881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b7055-4a6e-4148-b10b-029968e0eb98 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.620177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 55/111] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:26.646274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.656854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0d123-bac9-4987-bbba-a6a00ae5e337 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.661892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.662989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.663460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.663929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.665471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.667426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.669319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 56/112] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:26.675796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:26.686869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b372ec3-eebd-40a1-96b6-a3590eb583d0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:26.691880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:26.692908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.693375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.693827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.694737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:26.695948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:26.695948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:26.695948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:26.697554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d6ff9-bb52-4d26-afe2-43f61ff0a4ce admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:26.746150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 57/113] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:26 2021] PUT /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:26.828244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 57/114] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:26 2021] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:26.836365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c352-4cbc-4242-953b-c41a6c78771c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.836799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c352-4cbc-4242-953b-c41a6c78771c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.837150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3c352-4cbc-4242-953b-c41a6c78771c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.839371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 58/115] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:26.854922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3da2-14ab-4638-9133-e05e251e4381 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:26.855505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3da2-14ab-4638-9133-e05e251e4381 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:26.855995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b3da2-14ab-4638-9133-e05e251e4381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:26.882689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b18b3da2-14ab-4638-9133-e05e251e4381 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:26.884537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b18b3da2-14ab-4638-9133-e05e251e4381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:26.965141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 58/116] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:26.990582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c352-4cbc-4242-953b-c41a6c78771c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.005098 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3c352-4cbc-4242-953b-c41a6c78771c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.010608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.011499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.011791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.012121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.015885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7ccd-394f-40c9-afaf-cf7a26cd1be4 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.016175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7ccd-394f-40c9-afaf-cf7a26cd1be4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.016496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e7ccd-394f-40c9-afaf-cf7a26cd1be4 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.018448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 59/117] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:27.025914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.026233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.026482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.045198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:27.049019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:27.050299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:27.054379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:27.055945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 59/118] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:27.062964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.069404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 60/119] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:27.079676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cf855-908a-48a8-b48f-fe8d91eae1da admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.090811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.091556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.091842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.092253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.093566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:27.093879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.095731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.102729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.108140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 60/120] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:27.115859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.118944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80054f43-fce3-447b-bcaa-e5fea1cea04d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.123967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.125126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.125607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.126205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.128099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979fa21-ea1f-48bc-825d-6c525d3eac5f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.139712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.140567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.140848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.141132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.141606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:27.142361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.145690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.147327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 61/121] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:27.150084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:27.151502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 61/122] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:27.158110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.158687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.170885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7b15-7c83-41c8-87f0-af06773f8a15 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.171589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea7b7-5bd1-4653-808a-b4fa59f1a250 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.177577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.178543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.178944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.179179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.179315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.180145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.180672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.180771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.181256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.182208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:27.182717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.182994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.184753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.185886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 62/123] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:27.192392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.199323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 62/124] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:27.204710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a5e4a-68b3-4461-9c74-4be0aeeee66b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.205706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.210999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.211941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.212818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.213109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/333ab62b8878407e9fde1f4549e5372f/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.215613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcf143b1194ee4b2182082c9e5dcce, user_id=333ab62b8878407e9fde1f4549e5372f, role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.216969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930c090-3f03-48e6-9bcd-eb018de598ca admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.218619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e23f5-f4a5-4e8f-a7bc-2833a94c59a2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.221920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.222945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.223246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.223532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.224846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.227195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.229316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 63/125] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:27.235709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.245503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d721-08cc-441e-be8a-d95875d12eb3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.250791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.251654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.251961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.252327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] PATH_INFO: `/v3/projects/466137c38f41488b86ca3076c0fd289a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.253538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] RBAC: Authorizing `identity:get_project(project_id=466137c38f41488b86ca3076c0fd289a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.255609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.257537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 64/126] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:27 2021] GET /identity/v3/projects/466137c38f41488b86ca3076c0fd289a => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:27.263947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:27.273751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bbcf-787c-417f-bdbd-e38f1b62c88a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:27.278328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:27.279206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:27.279502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:27.281090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] PATH_INFO: `/v3/projects/466137c38f41488b86ca3076c0fd289a/users/333ab62b8878407e9fde1f4549e5372f/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:27.281861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466137c38f41488b86ca3076c0fd289a, user_id=333ab62b8878407e9fde1f4549e5372f, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:27.284622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7696a-e350-4f1c-a410-801f8b6ffca9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:27.323634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 63/127] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:27 2021] PUT /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/users/333ab62b8878407e9fde1f4549e5372f/roles/fccb1eae943b423e904443c48e4d0247 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:27.387842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 65/128] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:27 2021] PUT /identity/v3/projects/466137c38f41488b86ca3076c0fd289a/users/333ab62b8878407e9fde1f4549e5372f/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:29.512921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdc49-c640-4c8f-bc72-61fdce31d1cc None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.514469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdc49-c640-4c8f-bc72-61fdce31d1cc None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.514963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdc49-c640-4c8f-bc72-61fdce31d1cc None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.517000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 64/129] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:29.523201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.528995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.528995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.549023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:29.550517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:29.615982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 66/130] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:29.649369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdc49-c640-4c8f-bc72-61fdce31d1cc None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.664815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdc49-c640-4c8f-bc72-61fdce31d1cc None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.675189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.676265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.676760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.677261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.694292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:29.701450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:29.702837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 65/131] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:29.709449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.722036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fde98-8034-4e8e-92e0-eef74164b65f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.732428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.733461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.733947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.734418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.735358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:29.735830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:29.737683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:29.752411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 67/132] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:29.758966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.769586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38044639-01a0-49dc-bdca-90c187698c34 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.776013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.776924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.777221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.777508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.778730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:29.781543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:29.783164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 66/133] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:29.789405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.805425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3f6e1-8a8c-4086-98cb-689c58a1410f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.812617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.813574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.814041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.814498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.827844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:29.829911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:29.845535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 68/134] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:29.851445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.865681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a1ae-6c19-407f-b8ea-bb793380b9de admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.877354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.878227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.878522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.878815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.880021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:29.882152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b6247-ae78-44ea-a7f0-1111e13db19b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:29.884425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 67/135] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:29.891058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:29.905496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697e769-66ec-4436-a8a1-096bf33851b5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:29.912825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:29.913492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:29.913787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:29.914078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:29.914916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:29.915238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:29.917147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df1d6d-0b48-4051-9574-e29f7ebc4e2d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:29.923623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 69/136] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:29 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=c0c74397018c4e10ae44afe610b4259b => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:30.263190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bc76-2d65-439e-9491-61f1419ff791 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.263574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bc76-2d65-439e-9491-61f1419ff791 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.263784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bc76-2d65-439e-9491-61f1419ff791 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.265681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 68/137] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:30.271954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.272294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.272589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.297210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:30.298418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:30.306657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 70/138] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:30.352273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bc76-2d65-439e-9491-61f1419ff791 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.370532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bc76-2d65-439e-9491-61f1419ff791 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.377663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.378474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.378770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.379051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.397848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:30.404714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:30.405947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 69/139] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:30.412485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.425675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a5f9-7752-493f-989c-19dc68224b34 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.434177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.434859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.435151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.435438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.436430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:30.436752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:30.438396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:30.454767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 71/140] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:30.458503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.473374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63719390-5de4-4f62-9155-33bb8c715ce7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.484392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.485275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.485569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.485854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.487107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:30.488964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:30.490581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 70/141] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:30.497122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.508074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42f636-0f9b-4609-8dee-df84b33150a8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.520073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.520805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.521097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.521390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.531705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:30.533654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:30.546409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 72/142] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:30.552748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.569904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139820-7d06-4a18-9b29-ea0a6bfa6b67 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.581716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.582606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.582902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.583186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.584429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:30.586518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db23b8-e7c5-4288-8bcb-35df893c8d83 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:30.588461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 71/143] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:30.595866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:30.608833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de46d57-5c67-4f02-b55b-f293f43d76c6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:30.616547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:30.617259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.617547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.617830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.618728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:30.619043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:30.621101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b482e-c344-44e0-86fe-5b08b91faa17 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:30.628786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 73/144] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:30.902068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabca-dfdc-4ef7-a139-c0dc64bab8de None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.902432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabca-dfdc-4ef7-a139-c0dc64bab8de None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.902650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbabca-dfdc-4ef7-a139-c0dc64bab8de None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.904680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 72/145] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:30.919364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:30.919663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:30.919955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:30.945259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:30.946470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:30.955280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 74/146] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:30.999545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbabca-dfdc-4ef7-a139-c0dc64bab8de None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.019276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbabca-dfdc-4ef7-a139-c0dc64bab8de None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.030462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.031285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.031578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.031860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.046522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:31.053473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:31.054703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 73/147] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:31.061259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.070469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b03e9-b56e-47dd-8d67-01e623454d43 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.080890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.081588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.081882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.082170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.082943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:31.083258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.084948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.099705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 75/148] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.105757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.121447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a996a-429c-4d55-b980-6ea8a58c3cfc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.132552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.133702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.133995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.134283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.157820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.159928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.161705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 74/149] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.167939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.181210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39d32-bee2-49c0-9a41-914be4a66999 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.190215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.190883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.191176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.191463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.204280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.206117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.222895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 76/150] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:31.229111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.245788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2c47c-8deb-4a3c-8307-3b243fb90432 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.256662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.257554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.257847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.258135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.259609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.261740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8b597-68c1-4539-9360-11202acc8bb1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.263650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 75/151] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.271502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.281309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1856a-91c3-4c94-a8d1-494c851d892b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.292843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.293622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.293982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.294354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.295344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=8acc6ba08ebc4ff5b92ab4ee700be067) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:31.295724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.298242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ad2a-892b-41a1-92fa-b7ec34c9cfda admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.307272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 77/152] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/role_assignments?user.id=8acc6ba08ebc4ff5b92ab4ee700be067&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=c0c74397018c4e10ae44afe610b4259b => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.345051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8455a-f987-4fbc-9d46-601c52fbb2d8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.345628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8455a-f987-4fbc-9d46-601c52fbb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.346094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8455a-f987-4fbc-9d46-601c52fbb2d8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.348056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 76/153] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:31.361489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.361764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.362051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.388412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:31.389641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:31.400643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 78/154] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:31.445909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8455a-f987-4fbc-9d46-601c52fbb2d8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.464901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8455a-f987-4fbc-9d46-601c52fbb2d8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.472928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.473771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.474063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.474346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.489978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:31.497557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:31.499359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 77/155] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:31.506053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.519155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b039ae-dd2d-450d-8455-f3698b8e158d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.528459 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.529135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.529419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.530250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.530999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:31.531306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.532975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.548654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 79/156] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.554793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.566617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113a26b-ea34-4095-8090-89673896c292 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.582659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.583577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.583870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.584154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.585556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.587830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23adcd-6e12-4dd3-8844-32ea4a3062a0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.589654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 78/157] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.597521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.613756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2f2f7-22f9-41c3-ba65-798a639b375f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.625015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.625680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.625964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.626237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.641454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.643453 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.645574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adeb-5115-4c31-82af-e58d89256d91 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.645574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adeb-5115-4c31-82af-e58d89256d91 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.645574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adeb-5115-4c31-82af-e58d89256d91 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.646713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 79/158] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:31.653074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.654010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.654303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.658728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 80/159] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:31.665970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.674731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:31.675957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:31.681829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1539f69-4052-4bb2-b960-4eeb2b17d4e6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.689533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 80/160] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:31.697388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.698214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.698499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.698774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.700295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.702877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.705070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 81/161] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.711410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.717592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.727842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd2aae-fd7a-4861-808c-8ef0ce4edbc3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.735323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba7966-8faa-48b3-8715-28c64061cda0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.737354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.738020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.738303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.738582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.739416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:31.739728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.740765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:31.740765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:31.740765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:31.741978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195d7f-a3fa-4980-94ff-85f2290fe0b7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.748370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.749169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.749447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.749719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.752364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 81/162] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=fccb1eae943b423e904443c48e4d0247 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:31.764666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd505176-0ddb-46c8-bd7a-1cbf5b4c1170 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.764979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd505176-0ddb-46c8-bd7a-1cbf5b4c1170 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.765227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd505176-0ddb-46c8-bd7a-1cbf5b4c1170 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.767162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 82/163] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:31.777234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:31.784525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:31.785823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 82/164] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:31.792981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.793274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.793577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.801352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.822908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc516-8869-4bf3-85de-595e48d5c5c2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.824603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:31.825813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:31.835307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.835993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.836296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.836574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.837330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:31.837635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.839248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.842833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 83/165] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:31.854830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 83/166] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.861465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.877809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4aed9-2610-4c78-9c93-9c134c1d5ab8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.886203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.887092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.887373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.887649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.889437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.891619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.893605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 84/167] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:31.898367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.905436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.922183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5e69b-2bb0-4eb8-8548-e7491b750a22 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.926525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068bad-f506-45a8-b8f5-7e231d1b7337 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.936291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.936972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.937140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.937340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.937674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.937828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.938042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.938315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.949668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.951547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.961224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:31.962734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 85/168] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:31.969169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:31.969513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.970402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 84/169] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:31.977312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:31.978901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039b7cc-24f7-49d1-b3c9-5425a092b6f9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:31.984137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:31.985272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:31.985558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:31.985835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:31.987157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:31.989412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:31.991317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 86/170] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:31.998800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.006482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da3f8d-070a-4eee-91a0-9ed54cb763af admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.009849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcc445-8425-4f5a-885d-087f030baacc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.015005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.015808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.016166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.016547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.017550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:32.018012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.020142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb03958-1e38-4c7e-a340-950bb4ae566b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.020958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.021642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.021922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.022199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.022958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:32.023266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.024944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286123b-15a2-4839-b9a2-b53642b5329e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.026809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 87/171] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:32.038146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c12c-c68d-42e9-a141-c8f755506598 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.038480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c12c-c68d-42e9-a141-c8f755506598 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.038701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9c12c-c68d-42e9-a141-c8f755506598 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.040766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 88/172] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:32 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:32.045967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 85/173] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.052212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9c12c-c68d-42e9-a141-c8f755506598 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.056928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.057739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.058021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.086554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9c12c-c68d-42e9-a141-c8f755506598 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.099067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.100024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.100427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.100601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:32.100755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.101864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:32.102751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.105094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.111055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 89/174] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.117330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.118464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 86/175] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:32.129741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fa13-d334-4815-9da0-a33e62b9db41 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.137039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.137807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.138144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.138423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.147879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.149814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.161775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 90/176] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:32.162525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.169270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.176229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3c902-5547-4c0c-969d-e39ca8497e37 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.181694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.182663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.182944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.183219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.185180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee008cd-6653-4eac-bde7-655b2755a1ea admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.193799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.195008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:32.195208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.195772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.196324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] PATH_INFO: `/v3/projects/466137c38f41488b86ca3076c0fd289a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.200354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] RBAC: Authorizing `identity:get_project(project_id=466137c38f41488b86ca3076c0fd289a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.202353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:32.203062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.203574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 87/177] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:32.205226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 91/178] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/projects/466137c38f41488b86ca3076c0fd289a => generated 312 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.210104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.211886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.221459 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c61c5-2fea-414e-85f1-38fb8d1e6e82 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.226367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.226944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbc18-00e0-490b-bdbb-a183fe54f929 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.227050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.227314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.227590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.229245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:32.229245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.230589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.234998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.235947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.236490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.236938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.238053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=466137c38f41488b86ca3076c0fd289a, user.id=333ab62b8878407e9fde1f4549e5372f) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:32.238591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.240999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.242519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 88/179] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.249581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.254186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 92/180] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/role_assignments?user.id=333ab62b8878407e9fde1f4549e5372f&scope.project.id=466137c38f41488b86ca3076c0fd289a&role.id=c0c74397018c4e10ae44afe610b4259b => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:32.261212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c895af-c65c-403d-8157-f66c7e15e9ba admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.266161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.267055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.267336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.267608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.268997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.271210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.273245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 89/181] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.280096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.290607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcaf07e-52fd-466e-9b8b-6a2c60551e8d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.295418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.296087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.296425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.296707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.305779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.307597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.318554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 93/182] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:32.324865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.335691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96cf1a-4646-4af8-a4a6-8b98e41b8823 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.340650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.341533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.341811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.342171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.343467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.345582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b96cf7-5999-49d6-8b4b-2c4312586146 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.347367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 90/183] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.353909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.363687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7915-9410-4766-bfd6-f715397b7f92 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.368333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.369011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.369295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.369566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.370411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=8acc6ba08ebc4ff5b92ab4ee700be067) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:32.370725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.372672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56479217-ecac-43b2-a445-f24b12d9b500 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.379277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 94/184] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/role_assignments?user.id=8acc6ba08ebc4ff5b92ab4ee700be067&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=fccb1eae943b423e904443c48e4d0247 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.390273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4562-66d2-4886-b82f-5b9441fb53b4 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.390605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4562-66d2-4886-b82f-5b9441fb53b4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.390824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4562-66d2-4886-b82f-5b9441fb53b4 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.393096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 91/185] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:32.399408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.399797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.399978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.424138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:32.425435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:32.442909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 95/186] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:32.479025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4562-66d2-4886-b82f-5b9441fb53b4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.498228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4562-66d2-4886-b82f-5b9441fb53b4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.503534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.504096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.504431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.504759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.505983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.507800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33d0bc-5ca1-4726-aef6-ff4de7a77d75 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.509769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 92/187] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:32.516867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:32.526830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776fc34-f70c-42f1-8245-6319bdc624ee None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:32.532180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:32.533234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:32.533793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:32.534259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] PATH_INFO: `/v3/groups` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:32.535282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:32.536702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:32.536702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:32.536702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:32.538391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a58307-1be7-409f-8125-56171a39f3a6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:32.631555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 96/188] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:18:32 2021] POST /identity/v3/groups => generated 229 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:33.870635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9689-bba1-469d-8f6c-358b38130f25 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:33.871148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9689-bba1-469d-8f6c-358b38130f25 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:33.871222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d9689-bba1-469d-8f6c-358b38130f25 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:33.873287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 93/189] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:33.879330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:33.879718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:33.879896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:33.898646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:33.899841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:33.907919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 97/190] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:33.931725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9689-bba1-469d-8f6c-358b38130f25 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:33.944304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d9689-bba1-469d-8f6c-358b38130f25 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:33.948798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:33.949668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:33.949982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:33.950255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:33.961256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:33.968212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:33.969386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 94/191] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:33.975710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:33.985200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec5af-e60c-4c37-ac09-ae4bfeefdc0d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:33.989699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:33.990358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:33.990645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:33.990925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:33.991675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] RBAC: Adding query filter params (name=member) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:33.991983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:33.993638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.002165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 98/192] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:34.008151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.019434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af21d5c-1563-48b3-9b1d-e63c892ce3b2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.024320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.025178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.025464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.025743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.026942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.029115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.030899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 95/193] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:34.037207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.047723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20f618-68da-4088-85df-4ee0db01a81e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.052170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.053051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.053337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.053620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.054917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.057124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc92ed-1179-4e3f-a71c-243314785067 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.058986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 99/194] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:34.065245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.075412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53eadc-22d4-4b14-bca2-1944a56c6fee admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.080532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.081420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.081706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.087152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/8acc6ba08ebc4ff5b92ab4ee700be067/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.089317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f94dbee7074a698ede330affc5cf71, user_id=8acc6ba08ebc4ff5b92ab4ee700be067, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.092014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a179d98-a61c-4fb3-98d1-09f12920e903 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.169969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 96/195] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:34 2021] PUT /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/8acc6ba08ebc4ff5b92ab4ee700be067/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:34.421041 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b09-dcec-4c1c-b213-8205fb952667 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.421294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b09-dcec-4c1c-b213-8205fb952667 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.421578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b09-dcec-4c1c-b213-8205fb952667 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.423387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 100/196] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:34.430070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.430653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.431090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.449711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:34.451041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:34.509450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 97/197] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:34.533242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b09-dcec-4c1c-b213-8205fb952667 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.545841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b09-dcec-4c1c-b213-8205fb952667 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.550377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.551350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.551644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.551917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.564336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:34.571372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:34.572929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 101/198] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:34.580220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.590024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2848-4b33-4625-b7a7-6c406f125bc7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.595066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.595842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.596131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.596437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.597301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:34.597611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.599283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f555-75ef-4d0b-98e7-3bef815b387b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.609652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 98/199] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:34.615904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.626594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e3d00-ca8f-44ae-afb7-8c465a3725a1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.631183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.633839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134870e-6732-4311-bc6c-c31c793264a6 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.634081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.634179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134870e-6732-4311-bc6c-c31c793264a6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.634391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134870e-6732-4311-bc6c-c31c793264a6 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.634929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.635452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.636534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 99/200] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:34.637481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.640060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.642361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.642715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.642926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.643022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 102/201] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:34.649904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.660903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:34.662327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:34.662509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432df5-2f56-441a-ae23-cfc9bf8f34fd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.667228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.668071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.668393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.668674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.669831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.672717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.672954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 100/202] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:34.679332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 103/203] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:34.680794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.690701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ef00f-6ece-4ae2-92f5-d369e7460473 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.695647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.696894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.697479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.698078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.698912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.700752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f94dbee7074a698ede330affc5cf71, user_id=f29509a114484baab53625cc3aa60565, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.704279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.710161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34112889-e981-4ebd-b274-f1212c4035df admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.714414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.715206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.715487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.715788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.726113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:34.733721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:34.734954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 104/204] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:34.741936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.753081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35582a29-bd73-4b9f-a9b4-48e61e0ed466 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.757583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.758533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.758820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.759102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.759868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:34.760178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.761862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.771918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 105/205] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:34.777955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.787382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac539d-d179-460a-91ba-003479cd094d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.791591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.792567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.792858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.793149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.794331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.796993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ec663-293e-45a5-ade7-9332c4d0a657 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.798683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 106/206] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:34.802049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b645-7c16-40c4-8270-8f428c53a815 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.802339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b645-7c16-40c4-8270-8f428c53a815 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.802619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b645-7c16-40c4-8270-8f428c53a815 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.804278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 107/207] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:34.804970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4b645-7c16-40c4-8270-8f428c53a815 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.817208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4b645-7c16-40c4-8270-8f428c53a815 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.821351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.822144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.822425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.822699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.823832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.825918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee635-77c8-4968-91ce-033c45961934 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.828031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 108/208] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:34.832419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.832758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.833069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.851770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:34.853174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:34.861838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 109/209] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:34.863615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.872677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d16da-2a80-4328-81c1-864cfb2048c4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:34.877016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:34.877887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:34.878162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:34.878438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/8acc6ba08ebc4ff5b92ab4ee700be067/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:34.880605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f94dbee7074a698ede330affc5cf71, user_id=8acc6ba08ebc4ff5b92ab4ee700be067, role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:34.883610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:34.917611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 101/210] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:34 2021] PUT /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/f29509a114484baab53625cc3aa60565/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:34.918557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:34.988059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 110/211] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:34 2021] PUT /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71/users/8acc6ba08ebc4ff5b92ab4ee700be067/roles/fccb1eae943b423e904443c48e4d0247 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:34.996273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f635b5f-b4c2-4683-936a-e65f3fc8779b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:35.068621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:35.069513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:35.069800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:35.070127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:35.071542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:35.073379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d102a-44de-4efc-86ca-02537cb3d93a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:35.075442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 102/212] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:35.084357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:35.093835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e539f-5eef-471b-afa4-edd06e417c69 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:35.098697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:35.099406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:35.099690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:35.100014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] PATH_INFO: `/v3/groups` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:35.100788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:35.102873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19e01a-4ea5-4562-a6d0-1bfd73a86ef9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:35.175751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 111/213] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 10 03:18:35 2021] POST /identity/v3/groups => generated 226 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:36.367356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb1ba-2568-47f8-b7f4-27acf2527269 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.367827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb1ba-2568-47f8-b7f4-27acf2527269 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.367827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb1ba-2568-47f8-b7f4-27acf2527269 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.369758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 103/214] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:36.376119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a163-061b-440c-9290-5648e1713f7d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.376610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a163-061b-440c-9290-5648e1713f7d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.376684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a163-061b-440c-9290-5648e1713f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.399982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-af80a163-061b-440c-9290-5648e1713f7d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:36.401201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-af80a163-061b-440c-9290-5648e1713f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:36.409010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 112/215] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:36.433010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb1ba-2568-47f8-b7f4-27acf2527269 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.445863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb1ba-2568-47f8-b7f4-27acf2527269 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.451696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.452514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.452801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.453076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.463586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:36.472712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:36.474228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 104/216] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:36.480666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80a163-061b-440c-9290-5648e1713f7d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.489753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80a163-061b-440c-9290-5648e1713f7d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.494973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.495631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.495911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.496184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.496958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] RBAC: Adding query filter params (name=member) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:36.497263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:36.499400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:36.512439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 113/217] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:36.519018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.528774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ead63f-8696-47fe-ae02-94bc06ec3123 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.536065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.536951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.537234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.537507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.538694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:36.540865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:36.542455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 105/218] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:36.548847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.558563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa52f8-5cc2-4d08-9c06-2622b0d948ec admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.567053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.567716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.568000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.568300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.579750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:36.581543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:36.590699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 114/219] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:36.598607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.609235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542815-402a-4679-a360-a4b05e1d179d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.620294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.621078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.621363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.621635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.622810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:36.625410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15e17-6fe4-4c2f-bdfc-0580894f65c8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:36.627075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 106/220] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:36.633839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:36.642889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f57f-3574-4163-8f32-92bf06f99f7d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:36.647353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:36.648004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:36.648313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:36.648592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:36.649429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] RBAC: Adding query filter params (role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=8acc6ba08ebc4ff5b92ab4ee700be067) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:36.649737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:36.651565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202d50-225a-41e8-88e8-202d336a33e9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:36.660925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 115/221] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:36 2021] GET /identity/v3/role_assignments?user.id=8acc6ba08ebc4ff5b92ab4ee700be067&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=c0c74397018c4e10ae44afe610b4259b => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:37.438680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ea7-587c-403c-99b5-f8182d34edd0 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.439631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ea7-587c-403c-99b5-f8182d34edd0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.440113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ea7-587c-403c-99b5-f8182d34edd0 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.442105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 107/222] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:37.448230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.449059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.449529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.472415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:37.473945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:37.487261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 116/223] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:37.523919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871ea7-587c-403c-99b5-f8182d34edd0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.537561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871ea7-587c-403c-99b5-f8182d34edd0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.543731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.544793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.545828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.546315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.561800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:37.568887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:37.570325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 108/224] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:37.578397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.587851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0021549-00cb-444d-9d89-e79fdd4914b3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.593168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.594090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.594566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.595033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.596014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:37.596535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:37.598333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:37.611701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 117/225] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:37.617974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.628043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f224-28c8-4145-99eb-735c17f557c8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.635974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.637117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.637615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.638081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.640024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:37.642044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:37.643870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 109/226] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:37.650123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.660185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d828d4b-0669-4186-9394-12447683590a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.664831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.665700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.666188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.666654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.678025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:37.679828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:37.693983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 118/227] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:37.700388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.716223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ece91-93f1-4c2e-a99c-d526396c705f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.721913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.723027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.723510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.723975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.725374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:37.732220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10bff0-a730-449f-b182-da5f8f73d536 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:37.735007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 110/228] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:37.741651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:37.754989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332224f-5107-48b9-a30a-32daca977aa3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:37.761309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:37.761972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.762259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.762541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.763486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=f29509a114484baab53625cc3aa60565) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:37.764368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:37.766301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de322f2-e0e8-48e2-9055-979091ed6d6b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:37.777243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 119/229] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:37 2021] GET /identity/v3/role_assignments?user.id=f29509a114484baab53625cc3aa60565&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:37.940709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8868-a5fc-44b4-9d7c-057a6082b988 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.941333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8868-a5fc-44b4-9d7c-057a6082b988 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.941838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8868-a5fc-44b4-9d7c-057a6082b988 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.943872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 111/230] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:37.962897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:37.963126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:37.963386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:37.989266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:37.990498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:37.999169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 120/231] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:38.040118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8868-a5fc-44b4-9d7c-057a6082b988 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.061149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8868-a5fc-44b4-9d7c-057a6082b988 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.066267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.067363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.067842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.068466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.080219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:38.097239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:38.104734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 112/232] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:38.117843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.139067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef0ea5-ed69-4c4c-90fc-52242f1da72f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.148601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.149293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.149585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.149867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.150631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:38.150941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.152603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582ae5-f118-45b4-bd62-dccf2871fcdb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.168220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 121/233] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.175030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.185162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746e9f1-dadb-4148-bcf5-68ddd086b558 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.189568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7000-17de-4ef9-bd87-aba1d08254af None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.189568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7000-17de-4ef9-bd87-aba1d08254af None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.189568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd7000-17de-4ef9-bd87-aba1d08254af None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.191565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 122/234] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:38.197322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.197612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.197893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.198457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.199655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.200138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.200629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.202059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.204394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.206475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 113/235] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.212630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.224061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f892-15be-4832-985c-c725ae36b8a6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.228216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:38.228216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:38.240554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.241595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.242102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.242573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.250552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 123/236] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:38.257023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.259275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.269013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 114/237] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:38.275320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.289836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900c95b-82b5-46d9-8398-0454d637bded None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.295674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.300573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.301579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.301765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.302018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.303725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.305396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.307491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 124/238] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.307795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2190c-2044-412b-b642-b8579f41bed4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.316380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.317445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.317923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.318411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.333530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:38.340664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:38.342168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 115/239] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:38.347632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.348896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.359582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccd50e-b321-4cc9-95b9-85ca3be345b4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.363840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c240913-ce0f-4f26-81b6-80019dff0d60 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.371687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.372762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.373346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.373779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.374035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.374450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.374740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.375019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.375572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:38.375855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=a2f94dbee7074a698ede330affc5cf71, user.id=8acc6ba08ebc4ff5b92ab4ee700be067) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:38.376173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.376505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.378053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.378488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.392222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 125/240] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/role_assignments?user.id=8acc6ba08ebc4ff5b92ab4ee700be067&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=fccb1eae943b423e904443c48e4d0247 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.392713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 116/241] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.399115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.416218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281ba7-0820-4fcd-9975-a40b3b789ce4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.424587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.425255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.425545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.425828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.440875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.442758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.458510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 126/242] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:38.464693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.477916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfc656-ddf8-4216-814c-c897cf3ba073 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.488244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.489409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.489896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.490364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.491748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.494051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.495921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 117/243] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.502327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.513474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4addd-8ab3-480d-b4a4-653e89476649 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.523859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.524863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.525149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.525431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.536930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.538013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:38.538013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:38.538013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:38.539247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c35563-3f79-4113-b438-04748da6a145 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.541427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 127/244] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.548472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:38.558720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e132e0-d864-4eb5-8433-bc82e35f5fe0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:38.574016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:38.574927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.575354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.575765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.577323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:38.577774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:38.579746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b8e89-7b02-4e02-b5c4-031f6ef3685f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:38.589887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 118/245] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:38 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=c0c74397018c4e10ae44afe610b4259b => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:38.956038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c55-8b84-48cd-8701-68769b57ae61 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.956444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c55-8b84-48cd-8701-68769b57ae61 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.956647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c55-8b84-48cd-8701-68769b57ae61 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.958755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 128/246] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:38.965124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462466-064c-415f-8782-e8ac672dca42 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:38.965427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462466-064c-415f-8782-e8ac672dca42 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:38.965713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88462466-064c-415f-8782-e8ac672dca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:38.984976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-88462466-064c-415f-8782-e8ac672dca42 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:38.986194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-88462466-064c-415f-8782-e8ac672dca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:38.994758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 119/247] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:39.022218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213c55-8b84-48cd-8701-68769b57ae61 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.035113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213c55-8b84-48cd-8701-68769b57ae61 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.039571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.040416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.040705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.040977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.053475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:39.061453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:39.062978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 129/248] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:39.069458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88462466-064c-415f-8782-e8ac672dca42 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.078860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88462466-064c-415f-8782-e8ac672dca42 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.086034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.086775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.087069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.087348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.091709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:39.091709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.091709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.100063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 120/249] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.106085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.119096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196069b-602a-48dc-8a04-0540b83cb4d0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.124342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.124997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.125337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.125623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.135563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.137413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.146953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 130/250] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:39.153206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.163955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f12f-f245-4bf9-b602-44db9c4d4f2b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.172931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.173803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.174091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.174430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.176751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.178954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.181036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 121/251] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.187388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.201818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d647e-1db5-43cf-bcb8-ad17cdf6abbb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.212720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.213969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.214518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.214988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.221005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.223181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee0ff5-1b75-4e0c-985b-a2afff361507 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.225058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 131/252] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.231512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.245480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae882-6c6f-48c9-8093-55b34a39346f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.252708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.253436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.253718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.253993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.254893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:39.255209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.257266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdc47-8ab9-4f24-8f66-1e2428c1e205 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.265189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 122/253] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=fccb1eae943b423e904443c48e4d0247 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.609879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e67f96-c1af-4c66-b5d8-1774f27d03b8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.610839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e67f96-c1af-4c66-b5d8-1774f27d03b8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.611338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e67f96-c1af-4c66-b5d8-1774f27d03b8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.613345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 132/254] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:39.619552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.620461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.620944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.640154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:39.641696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:39.649905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 123/255] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:39.693893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e67f96-c1af-4c66-b5d8-1774f27d03b8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.712266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e67f96-c1af-4c66-b5d8-1774f27d03b8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.717591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.718658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.719136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.719598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.734874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:39.741963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:39.743405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 133/256] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:39.750668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.765771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323880a-b1b5-4012-8f19-87e26bc072d5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.775931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.776649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.776940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.777225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.777989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:39.778302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.779951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.792440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 124/257] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.799365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.814325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78881c-3b52-42de-8c7a-897ca4bd4de5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.824567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.825577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.826077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.827063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.840160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.842359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.858483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 134/258] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:39.865069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.881392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1740f-9e89-4e73-8f35-9e450d015d67 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.892429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.893308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.893597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.893874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.895102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.897207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.898898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 125/259] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.905164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.915846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734c01-d32a-44d9-a1d1-7dced54f7948 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.924487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.925579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.926076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.926548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.932918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.935005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53275158-8621-4e13-bb6f-135e1434c4e2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.937416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 135/260] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:39.944144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:39.957279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a7c9-0a31-4c13-9793-7b32e609c5f4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:39.967919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:39.968613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:39.968902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:39.969182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:39.970029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=a2f94dbee7074a698ede330affc5cf71) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:39.970347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:39.972227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa4941-5054-4eed-8960-5a701f3b6f92 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:39.978141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 126/261] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:39 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=c0c74397018c4e10ae44afe610b4259b => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:40.271593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1bb1-bf34-48e5-b13c-c50a601a5724 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.271994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1bb1-bf34-48e5-b13c-c50a601a5724 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.272170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c1bb1-bf34-48e5-b13c-c50a601a5724 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.274275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 136/262] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:40.281297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.281592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.281876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.304386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:40.305575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:40.314053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 127/263] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:40.341479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1bb1-bf34-48e5-b13c-c50a601a5724 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.358375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c1bb1-bf34-48e5-b13c-c50a601a5724 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.364890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.365752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.366036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.366314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.381605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:40.389203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:40.390767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 137/264] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:40.397251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.409699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccc833-50ff-4c21-b66e-81901b02afd6 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.419977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.421213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.421505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.421784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.422544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:40.422855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:40.424480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:40.433210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 128/265] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:40.439583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.449830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efe3d-f2b4-41c4-b5c3-f4c4ce85f1a1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.461395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.462110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.462395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.462675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.477657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:40.479452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:40.489350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 138/266] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:40.496132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.509593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6f9d-6f14-4144-9795-d0c3712e96bd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.519847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.520745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.521033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.521313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.522576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:40.524608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:40.526288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 129/267] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:40.533122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.546764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df424b-b34e-480c-881c-4eae2993017a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.551493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.552511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.552836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.553164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.555114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:40.557223 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9b25-2c50-41a5-a770-40d32993c34d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:40.559071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 139/268] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:40.565857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:40.581609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd507b-1e4d-4124-8163-2c54aadf50b0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:40.586558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:40.587219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:40.587509 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:40.587789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:40.588660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=a2f94dbee7074a698ede330affc5cf71) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:40.588985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:40.590823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71425a8b-b6a6-46a3-8bc5-b357b93e1dca admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:40.604701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 130/269] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:40 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=fccb1eae943b423e904443c48e4d0247 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.077690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea7a4-dbb7-4971-8d9e-6dab69363a25 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.078407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea7a4-dbb7-4971-8d9e-6dab69363a25 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.078407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ea7a4-dbb7-4971-8d9e-6dab69363a25 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.080559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 140/270] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:41.091518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.092722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.092722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.119550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:41.120790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:41.129400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 131/271] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:41.164575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ea7a4-dbb7-4971-8d9e-6dab69363a25 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.181903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ea7a4-dbb7-4971-8d9e-6dab69363a25 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.187059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.187853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.188134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.188431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.209701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:41.216549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:41.218598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 141/272] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:41.224678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.238355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1377d-f9a8-49a8-81f1-51ba554d248e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.247862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.249087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.249373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.249652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.250409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:41.250721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.252352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.264712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 132/273] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.270620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.284631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720400d-7d38-4f60-ab31-509b0bdde1a5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.289297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.289947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.290232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.290509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.305286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.307161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.317425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 142/274] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:41.323313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.333603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29471d-1019-4a44-85d2-87f7b6d64644 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.342375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.343296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.343579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.343851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.346229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] RBAC: Authorizing `identity:get_project(project_id=d847766cb8f7495b8c5c2a2d48910f07)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.348121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.350186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 133/275] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.356183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.366095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11db964-84f8-489d-96b2-872368cf75cf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.376750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.377636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.377921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.378197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] PATH_INFO: `/v3/groups/09927f880c754df284566548fb8bce8c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.389560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] RBAC: Authorizing `identity:get_group(group_id=09927f880c754df284566548fb8bce8c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.391531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7803c6-391b-42e2-a6f9-61df721977ed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.393377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 143/276] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/groups/09927f880c754df284566548fb8bce8c => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.400139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.413976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77db58-121a-465c-be33-8d8b54f6889b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.424124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.424855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.425115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.425400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.426251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] RBAC: Adding query filter params (group.id=09927f880c754df284566548fb8bce8c, role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d847766cb8f7495b8c5c2a2d48910f07) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:41.426570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.428482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211d89-a0dc-46d0-96c9-c3ed816901b8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.434725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 134/277] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/role_assignments?group.id=09927f880c754df284566548fb8bce8c&scope.project.id=d847766cb8f7495b8c5c2a2d48910f07&role.id=cb3f52d5910b4e919a2580970bca865a => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.467882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cc9b-826d-4f6e-9db9-4625c9c8bff9 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.468221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cc9b-826d-4f6e-9db9-4625c9c8bff9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.468474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511cc9b-826d-4f6e-9db9-4625c9c8bff9 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.470593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 144/278] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:41.476596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.476871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.477156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.505438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:41.506681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:41.520299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 135/279] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:41.556943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511cc9b-826d-4f6e-9db9-4625c9c8bff9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.578109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511cc9b-826d-4f6e-9db9-4625c9c8bff9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.583463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.584362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.584581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.584859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.606596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:41.614272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:41.615821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 145/280] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:41.622010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.632166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269f2cb-d017-41f3-b961-6b667f731c4a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.645194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.645937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.646219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.646496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.647319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:41.647629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.649269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.658859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 136/281] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.664775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.675359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b287-7513-4adf-8f4c-78d67b43dfc5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.683583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.684473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.684752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.685026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.686746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.688648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.690223 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 146/282] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.702113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.711994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fc16b-eb68-4bd1-8552-9c223f7898e3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.720895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.721754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.722033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.722306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.723504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.725562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79686d-5832-465c-9877-6f5f235d4ec1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.727501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 137/283] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:41 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:41.733986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:41.750153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6731f-69db-4c4a-b231-ca618d28a8c4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:41.755797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:41.756690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:41.756969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:41.757243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/groups/db41242850724516af4663408ccfdd79/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:41.761474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcf143b1194ee4b2182082c9e5dcce, group_id=db41242850724516af4663408ccfdd79, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:41.764136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138cd0-0d7a-49e5-b0fe-71c8bb6ea9d9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:41.853525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 147/284] 10.222.0.21 () {58 vars in 1464 bytes} [Tue Aug 10 03:18:41 2021] PUT /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/groups/db41242850724516af4663408ccfdd79/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:42.398735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8e9c-5221-4274-8aa9-4c731e2e05ba None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.399447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8e9c-5221-4274-8aa9-4c731e2e05ba None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.399447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8e9c-5221-4274-8aa9-4c731e2e05ba None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.401322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 138/285] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:42.407913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646387-a7ad-475e-9d73-bf877b7ba527 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.408836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646387-a7ad-475e-9d73-bf877b7ba527 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.409321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646387-a7ad-475e-9d73-bf877b7ba527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.434363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ad646387-a7ad-475e-9d73-bf877b7ba527 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:42.436030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ad646387-a7ad-475e-9d73-bf877b7ba527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:42.510472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 148/286] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:42.548189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d8e9c-5221-4274-8aa9-4c731e2e05ba None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.562659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191696-fa73-4029-afdf-8d8d7ae6d173 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.562963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191696-fa73-4029-afdf-8d8d7ae6d173 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.563235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b191696-fa73-4029-afdf-8d8d7ae6d173 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.564836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d8e9c-5221-4274-8aa9-4c731e2e05ba None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.565282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 149/287] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:42.573406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.573566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.573773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.573969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.574219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.574502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.574767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.587090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:42.596254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:42.597802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 139/288] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:42.604023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.605228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:42.606419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:42.616424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aac462-1544-4d07-a0bf-6cab8debbaac admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.621136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.621833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.622117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.622447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.623224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:42.623580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.623978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 150/289] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:42.625353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.639445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 140/290] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:42.645566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.661473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.662051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa05f1d-e703-4ae9-b8b4-f2558301cfa9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.671274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.671683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0445f0-c501-4630-95d4-587b5be1c20e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.672137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.672444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.672721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.676434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.676914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.677322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.677605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.677880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.678837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.680862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 151/291] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:42.687443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.690095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:42.697605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:42.699073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 141/292] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:42.706924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.708356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62d56b-511b-4d97-8443-0952d0823cbf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.717741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359553a-5040-46ef-bf3c-a243b77f2dc8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.722285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.723035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.723322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.723598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.724549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:42.724840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.725023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.725704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.725992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.726274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.726492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.727493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.729560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.732384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 152/293] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:42.736517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 142/294] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:42.737655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.742605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.754348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74084-94d0-4a03-9bff-ff1a02a55d18 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.754967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626c14-d746-49a4-b6f9-8961264bb2e0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.758646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.759579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.759811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.760139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.761273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.761413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.768216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:42.768216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:42.768216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:42.768216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.768216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 143/295] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:42.768788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.769313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.769805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/groups/db41242850724516af4663408ccfdd79/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.771511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.772999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdcf143b1194ee4b2182082c9e5dcce, group_id=db41242850724516af4663408ccfdd79, role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.775842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae83944-fde9-4c38-94c9-d1f9b636ee9f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.784475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5353d9-ac38-4b69-a085-597c16b43891 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.789026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.790043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.790377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.792081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.792081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.794463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.797489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 144/296] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:42 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:42.804371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:42.815895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b568-1463-4e59-ad7b-67cd743cf64f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:42.821096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:42.822171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:42.822455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:42.822734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71/groups/db41242850724516af4663408ccfdd79/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:42.826653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f94dbee7074a698ede330affc5cf71, group_id=db41242850724516af4663408ccfdd79, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:42.828581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45167-a75a-48ba-9114-4873e8ac8ae2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:42.853179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 153/297] 10.222.0.21 () {58 vars in 1464 bytes} [Tue Aug 10 03:18:42 2021] PUT /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce/groups/db41242850724516af4663408ccfdd79/roles/fccb1eae943b423e904443c48e4d0247 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:42.919007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 145/298] 10.222.0.21 () {58 vars in 1464 bytes} [Tue Aug 10 03:18:42 2021] PUT /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71/groups/db41242850724516af4663408ccfdd79/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:43.721226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc311-57a3-49eb-9ce2-055aee767196 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.722251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc311-57a3-49eb-9ce2-055aee767196 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.722747 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fc311-57a3-49eb-9ce2-055aee767196 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.725021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 154/299] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:43.738914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8fc65-120f-4ce0-a8fc-8bd1b6685747 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.739822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8fc65-120f-4ce0-a8fc-8bd1b6685747 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.740343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8fc65-120f-4ce0-a8fc-8bd1b6685747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.769213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e7f8fc65-120f-4ce0-a8fc-8bd1b6685747 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:43.770751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e7f8fc65-120f-4ce0-a8fc-8bd1b6685747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:43.843234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 146/300] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:43.878948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc311-57a3-49eb-9ce2-055aee767196 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:43.891000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaee9-4cc9-4384-8594-7acbde305138 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.892601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaee9-4cc9-4384-8594-7acbde305138 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.893254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcaee9-4cc9-4384-8594-7acbde305138 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.897725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 147/301] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:43.898501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fc311-57a3-49eb-9ce2-055aee767196 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:43.902540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.903456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.904333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.911439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:43.912548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.913035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.913508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.937004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:43.938562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:43.939635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:43.947133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:43.950755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 155/302] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:43.954481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 148/303] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:43.957663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:43.969461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec2778-f498-4fe7-8c60-dd9443bbcd08 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:43.979342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:43.980296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:43.980789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:43.981269 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:43.982272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:43.982830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:43.984638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:43.993788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 156/304] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:43.999384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.000817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.009265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72793582-9d57-4c2e-bab9-3b989e831969 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.015682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11545-5741-40f8-a61c-20a299338be1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.019887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.020095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.021035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.021316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.021581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.021869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.022347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.022737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.023121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.024657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.026508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 157/305] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:43 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:44.035163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.042210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:44.049525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:44.051251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 149/306] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:44.053268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0049-c67e-4acd-ae68-04edc9afcc80 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.061184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.063810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.064715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.065000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.065277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.066464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.068778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.071225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 158/307] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:44 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:44.078805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e3577-8c08-4ff8-bb4b-86a334d59d16 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.081396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.085826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.086827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.087372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.087881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.093075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:44.093401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.095096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.097252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922540f-f41e-4d45-96ed-a7b1790f9b91 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.102173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.103286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.103783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.104284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71/groups/db41242850724516af4663408ccfdd79/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.112009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 150/308] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:44.117603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f94dbee7074a698ede330affc5cf71, group_id=db41242850724516af4663408ccfdd79, role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.120485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70924519-fca8-4e96-9948-5289d79cb79f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.125857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.137669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46de17-202d-4ce5-a28a-c3b1d3664f3a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.146244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.147098 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.147378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.147647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] PATH_INFO: `/v3/groups/09927f880c754df284566548fb8bce8c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.148842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] RBAC: Authorizing `identity:get_group(group_id=09927f880c754df284566548fb8bce8c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.150763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.152587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 151/309] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:44 2021] GET /identity/v3/groups/09927f880c754df284566548fb8bce8c => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:44.158930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.169388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203496b3-3143-4e16-b998-61c379545361 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.174539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.175662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.176168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.176685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.178176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] RBAC: Authorizing `identity:get_project(project_id=d847766cb8f7495b8c5c2a2d48910f07)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.180349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.182612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 152/310] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:44 2021] GET /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:44.189507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.204377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 159/311] 10.222.0.21 () {58 vars in 1464 bytes} [Tue Aug 10 03:18:44 2021] PUT /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71/groups/db41242850724516af4663408ccfdd79/roles/fccb1eae943b423e904443c48e4d0247 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:44.208088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818b21-8fab-4621-99f1-bf4584174a1b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.268749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.270014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.270495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.270981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07/groups/09927f880c754df284566548fb8bce8c/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.272997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d847766cb8f7495b8c5c2a2d48910f07, group_id=09927f880c754df284566548fb8bce8c, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:44.276019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e44d-5b4a-4fef-bf0f-f7fdb090e99f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:44.341387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 153/312] 10.222.0.21 () {58 vars in 1464 bytes} [Tue Aug 10 03:18:44 2021] PUT /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07/groups/09927f880c754df284566548fb8bce8c/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:18:44.827050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ae70-96df-47e5-b32d-bb320b74bae0 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.828149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ae70-96df-47e5-b32d-bb320b74bae0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.828677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268ae70-96df-47e5-b32d-bb320b74bae0 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.830943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 160/313] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:44.836809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.837291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.837383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:44.864782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:44.866036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:44.934864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 154/314] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:44.967756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268ae70-96df-47e5-b32d-bb320b74bae0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:44.989784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268ae70-96df-47e5-b32d-bb320b74bae0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:44.997703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:44.999022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:44.999307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:44.999583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.013774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:45.020701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:45.028615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 161/315] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:45.035407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.048294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a603f-6b77-4b62-90c5-41d7b0170c82 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.056787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.057461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.057745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.058020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.058768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:45.059070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.060781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.069735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 155/316] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:45.076639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.087131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bef607-8bc6-48cd-8173-9baf09945733 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.096334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.097512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.097799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.098077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.113436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.115197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.126040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 162/317] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:45.132145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.142922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e8d2f-552b-4051-bd6b-42223be15cff admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.152574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.153511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.153790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.154083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.160953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.163117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.164863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 156/318] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:45.171522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.184870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72cd15-5cdf-4ad5-85e7-55718f0d2498 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.196834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.197697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.197974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.198248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.199445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.201984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ff7b7-05f7-4ede-b050-c3163436ebec admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.203863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 163/319] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:45.210309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.222032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccbec5-35b0-46bf-8eb7-da89b8d90edd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.234678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.237007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.237007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.237007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.237007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:45.237299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.239227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aadedf-0e86-4de7-8223-cfeaca37f957 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.245836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 157/320] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=c0c74397018c4e10ae44afe610b4259b => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:45.786122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7d985-ae4e-4a37-819a-adf8b8d53cec None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.786420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7d985-ae4e-4a37-819a-adf8b8d53cec None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.786679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7d985-ae4e-4a37-819a-adf8b8d53cec None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.788801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 164/321] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:45.794934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c97f-8a5c-4510-ac0e-14c18258fd8f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.795229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c97f-8a5c-4510-ac0e-14c18258fd8f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.795510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763c97f-8a5c-4510-ac0e-14c18258fd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.815198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-3763c97f-8a5c-4510-ac0e-14c18258fd8f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:45.816477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3763c97f-8a5c-4510-ac0e-14c18258fd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:45.824363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 158/322] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:45.825203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913bc9-a855-4509-bef3-190a733f5b62 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.825772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913bc9-a855-4509-bef3-190a733f5b62 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.826775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8913bc9-a855-4509-bef3-190a733f5b62 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.828820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 165/323] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:45.835997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.836548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.837038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.849446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913bc9-a855-4509-bef3-190a733f5b62 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.865083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8913bc9-a855-4509-bef3-190a733f5b62 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.871250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:45.872484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:45.874011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.875182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.875775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.876357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.881593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 159/324] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:45.890904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:45.899648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:45.901371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 166/325] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:45.908221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.908646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.918500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1537-7d5f-4c2e-a1e9-df8989e14421 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.918909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8b003-657b-44af-bb11-5157b4abb1a4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.923636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.924476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.924764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.925042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.925639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.926571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.926993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.927476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.928451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:45.928925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.930681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.937215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:45.942756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 167/326] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:45.945054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 03:18:45.949120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.951711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 160/327] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:45.952924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.962039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90f10a-9696-4415-a548-61052cb2bcb1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.962570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179129-50bc-4568-addc-de9fc36f570a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:45.967701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.968283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:45.968831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.969049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:45.969431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.969658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:45.969798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.970280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:45.970689 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:45.971062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.972876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.979531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:45.981645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:45.988044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 161/328] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:45.990218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:45.992812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 168/329] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:45.999088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.000911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01894-5b45-4bef-99b0-0561af4cae53 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.005513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.006223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.006585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.006940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.010273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0061b-9fc1-4863-823d-9ed938980c70 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.015685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.016052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.016981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.017446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.017953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.018069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.019433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.021818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.024104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 169/330] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:46.028237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 162/331] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:46.031104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.034054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.041673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5485-4100-4c67-a522-47c261964316 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.042596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164b4d-b962-4a71-bbee-609a805b5089 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.047103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.048074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.048546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.048943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.049234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.049449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.049544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.050179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.050674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.051837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.052736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.054301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.056413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 170/333] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:46.056532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 163/333] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:46.060713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.063385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.070403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d035-4689-4757-843b-d0e83695ad7d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.074115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3704e7-5cee-42fd-a47b-aa189d85323b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.076446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.077301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.077589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.077866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.079038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.080724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.080966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.084313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 164/334] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:46.087324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.087843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.088368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.088964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.089823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:46.090335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.092773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa70b80-7386-4066-8dc3-7c2c51880c3b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.099580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 171/335] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce&role.id=fccb1eae943b423e904443c48e4d0247 => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:46.099720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967012f8-1fad-447e-90de-f29161d46a0f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.113192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.113995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.114289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.114572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.115575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=c0c74397018c4e10ae44afe610b4259b, scope.project.id=a2f94dbee7074a698ede330affc5cf71) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:46.115767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.117842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98032a3-767e-4395-91ba-7056e9820eab admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.128368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 165/336] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=c0c74397018c4e10ae44afe610b4259b => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:46.813584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d2a9b-cc69-425e-a2e0-3336e6c50cc3 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.813868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d2a9b-cc69-425e-a2e0-3336e6c50cc3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.814143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d2a9b-cc69-425e-a2e0-3336e6c50cc3 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.815933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 172/337] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:46.822404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3713b-3f62-4fab-ba90-8894372ccc1a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.822690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3713b-3f62-4fab-ba90-8894372ccc1a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.822963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3713b-3f62-4fab-ba90-8894372ccc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.840982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-05e3713b-3f62-4fab-ba90-8894372ccc1a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:46.842819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-05e3713b-3f62-4fab-ba90-8894372ccc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:46.850583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 166/338] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:46.875477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d2a9b-cc69-425e-a2e0-3336e6c50cc3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.888124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d2a9b-cc69-425e-a2e0-3336e6c50cc3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.892927 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.893711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.893991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.894266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.904210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:46.907916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a2140-41b6-4daf-9541-af738b561f13 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.908218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a2140-41b6-4daf-9541-af738b561f13 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.908516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a2140-41b6-4daf-9541-af738b561f13 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.910275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 167/339] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:46.912033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:46.913306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 173/340] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:46.915817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.916102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.916418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.919497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.929227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8b71-9640-4207-900b-ecbbcc6da283 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.933522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.933754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:46.934143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.934426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.934701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.934915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:46.935925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:46.936285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.937802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.942836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 168/341] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:46.945802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 174/342] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:46.952169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.961103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a529ce-f9d6-4ff0-8884-bc69fabe07bb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.965554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.966172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.966456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.966733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.967980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.974719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:46.976474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:46.977191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af700a49-c7fc-436f-9550-2c361adcfe1b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:46.981448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:46.982234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:46.982521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:46.982802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:46.985107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 169/343] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:46.991093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:46.993834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:46.999674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5e25-9e44-4726-b363-a860cdb97f1a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.001164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:18:47.002420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 175/344] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:47.003968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.004803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.005086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.005360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.006503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.008561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.008779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.010368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 170/345] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:46 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:47.015882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.017942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3f22-1d3f-4663-8470-4222523fe57e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.022292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.022998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.023352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.023697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.024559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:47.024870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.024968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df87e6-df12-4b4e-b133-904a72c0a05b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.026494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.029776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.030605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.030948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.031284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] PATH_INFO: `/v3/groups/db41242850724516af4663408ccfdd79` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.032526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=db41242850724516af4663408ccfdd79)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.034343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.035969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 171/346] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/groups/db41242850724516af4663408ccfdd79 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:47.036074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 176/347] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:47.041580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.041789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.051205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e361-8698-4ae3-aecd-a300b845c1e7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.051392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfcb2b-39e8-4eec-b1d3-655a57330d79 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.055472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.055660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.056070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.056242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.056415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.056546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.056685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.056829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.057432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] RBAC: Adding query filter params (group.id=db41242850724516af4663408ccfdd79, role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=a2f94dbee7074a698ede330affc5cf71) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:47.057741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.059511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.064313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.065125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 177/348] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/role_assignments?group.id=db41242850724516af4663408ccfdd79&scope.project.id=a2f94dbee7074a698ede330affc5cf71&role.id=fccb1eae943b423e904443c48e4d0247 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:47.075903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.075903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 172/349] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:47.082117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.092897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38098972-19a7-4f6f-b79a-c2fcb4bab327 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.097376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.098250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.098535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.098812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.100047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] RBAC: Authorizing `identity:get_project(project_id=d847766cb8f7495b8c5c2a2d48910f07)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.101878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.103617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 178/350] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:47.110278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.123917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f0903-0c1c-4562-9bdf-c8e85111592e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.130276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.131145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.131431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.131708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] PATH_INFO: `/v3/groups/09927f880c754df284566548fb8bce8c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.133281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] RBAC: Authorizing `identity:get_group(group_id=09927f880c754df284566548fb8bce8c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.135230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634c8c1-01b0-4b96-ae30-1d6fb2c6bf37 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.136957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 173/351] 10.222.0.21 () {56 vars in 1202 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/groups/09927f880c754df284566548fb8bce8c => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:47.144273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:47.154289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d927be-1516-44e9-98df-33fc3a982a5e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:47.158638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:47.159299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:47.159589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:47.159866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:47.160744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] RBAC: Adding query filter params (group.id=09927f880c754df284566548fb8bce8c, role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d847766cb8f7495b8c5c2a2d48910f07) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:47.161059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:47.162902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3199f5-139a-48e2-98e8-ba6d0c158e44 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:47.169406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 179/352] 10.222.0.21 () {56 vars in 1398 bytes} [Tue Aug 10 03:18:47 2021] GET /identity/v3/role_assignments?group.id=09927f880c754df284566548fb8bce8c&scope.project.id=d847766cb8f7495b8c5c2a2d48910f07&role.id=cb3f52d5910b4e919a2580970bca865a => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:49.718827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd62f-c0c8-4b32-ad0d-392b38981fe6 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.719868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd62f-c0c8-4b32-ad0d-392b38981fe6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.720413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd62f-c0c8-4b32-ad0d-392b38981fe6 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.722651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 174/353] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:49.734975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.735889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.736404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.758876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:49.760442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:49.769257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 180/354] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:49.804870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd62f-c0c8-4b32-ad0d-392b38981fe6 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:49.818742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd62f-c0c8-4b32-ad0d-392b38981fe6 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:49.828721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:49.829938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.830432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.830907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.843404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:49.845757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:49.868395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-cadb0ce1-fa12-4f1f-9229-a0e3cd8a161e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:49.869938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 175/355] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:49.876971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:49.890240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b7140-fdf2-446b-a29d-07db185b0305 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:49.900389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:49.901057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.901343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.901624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.902345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:49.902648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:49.903660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:49.903660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:49.903660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:49.904599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:49.913433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9798-2e8c-4392-aff7-cd5e876ba1fb None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.913993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9798-2e8c-4392-aff7-cd5e876ba1fb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.914447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a9798-2e8c-4392-aff7-cd5e876ba1fb None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.916730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 176/356] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:49.927725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 181/357] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:49.928695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.928989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.929268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.934007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:49.944872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9377ae8-a664-45b0-93ff-a31600c9bf55 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:49.952244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:49.953184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:49.953660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:49.954184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:49.955071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:49.957186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40b700-4f7c-43e2-aa61-c5db06765656 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:49.957314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:49.958563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:49.978352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 177/358] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:50.001777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.011824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54a99f-2913-4520-b4e8-97bff09bdb17 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.017387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.018501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.019043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.019497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.033918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.035915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.054776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:50.059384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 178/359] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:50.062651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.073159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1066b93-aad9-4bc1-a30f-55edd89d8a74 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.078465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.079308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.079761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.080262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.081144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:50.081638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.083444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.097427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 179/360] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:50.103051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 182/361] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:49 2021] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:50.113134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.125175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ff8af-7cd7-460d-8188-114ed27f60f0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.130271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.131153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.131621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.132185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.133348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.135557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f014-9542-41b3-a11c-de504376a2f0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.306465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 180/362] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:50 2021] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:50.432400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7de7-c40b-4773-9ed1-c12c4757d218 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.432808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7de7-c40b-4773-9ed1-c12c4757d218 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.432999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae7de7-c40b-4773-9ed1-c12c4757d218 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.434786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 183/363] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:50.442680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.442987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.443257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.469900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:50.471495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:50.486068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 181/364] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:50.511952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae7de7-c40b-4773-9ed1-c12c4757d218 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.527759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae7de7-c40b-4773-9ed1-c12c4757d218 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.538623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.538623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.538623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.538623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.545840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.547913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.565635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:50.567031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 184/365] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:50.573681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.584103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65afc-668e-4f7c-9e40-fe622aa149e7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.590289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.590289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.590771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.591238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.592323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:50.592874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.594719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f44cf-e289-4638-a033-28525b35c9b6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.609410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 182/366] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:50.616222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.630326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03b46-10ee-4942-97b9-ba40608f1199 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.636569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.637449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.637990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.638525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.639428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.641660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8d684-30c3-4d18-ae37-6e867f51c7dc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.659296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ba8f-06e6-4a4c-9ae8-423f10ff518c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.659577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ba8f-06e6-4a4c-9ae8-423f10ff518c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.659858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36ba8f-06e6-4a4c-9ae8-423f10ff518c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.662148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 183/367] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:50.667693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.667989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.668303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.790862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:50.793430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:50.802249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 184/368] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:50.827817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.837338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672014a1-ca12-4200-b291-c1024d21e572 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.842912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.843940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.844396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.844816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.855731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.858442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.875695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:50.882487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 185/369] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:50.884132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.894095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4afe1-96ec-4f2f-a332-1d5774a1bba9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.898966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.899831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.900291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.900760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.901632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:50.902134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.904470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:50.916719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 186/370] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:50.923848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:50.934327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb350cbd-2a94-4bbf-8a98-d3c4c0054c08 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:50.939227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:50.944011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:50.944011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:50.944011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:50.944011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:50.944011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e159f9-e013-4ae4-bc49-2939a2c43f77 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:51.097295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 185/371] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:50 2021] POST /identity/v3/users => generated 248 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:51.141443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 187/372] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:50 2021] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:18:51.402854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2c48-937c-45e7-a11b-5676bef12bbe None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:51.403224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2c48-937c-45e7-a11b-5676bef12bbe None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:51.403425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2c48-937c-45e7-a11b-5676bef12bbe None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:51.405623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 186/373] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:51.412573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:51.412871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:51.413156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:51.433440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:51.434649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:51.444477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 188/374] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:51.469845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c2c48-937c-45e7-a11b-5676bef12bbe None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:51.484689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c2c48-937c-45e7-a11b-5676bef12bbe None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:51.490863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:51.491541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:51.491824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:51.492119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:51.492872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:51.494490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:51.555815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.sql.core [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 03:18:51.555815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 03:18:51.555815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [parameters: {'id': 'c7d11d63f3cb4ffe99d3eb5d1016a880', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 03:18:51.555815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 03:18:51.570621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 03:18:51.572377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 187/375] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:18:51 2021] POST /identity/v3/roles => generated 144 bytes in 103 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:51.579145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:51.593457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404297f-061d-4586-bfe7-9d25fc66f58b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:51.600778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:51.601595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:51.601885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:51.602172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:51.624540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:51.631877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-61d6f687-4994-474b-bae7-6ca8e6a7c4bb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 03:18:51.639181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 189/376] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:18:51 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:51.640141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:51.658764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ea815-9aa3-4bcb-a283-2a5d3789dfb9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:51.673162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:51.673868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:51.674157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:51.674437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:51.675217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:51.675529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:51.677227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751d28-5d47-4e5d-82f7-c2047f05ac6a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:51.690714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 188/377] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:51 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:52.770317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ce5a-4a74-473d-8584-138ae96feb59 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.771008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ce5a-4a74-473d-8584-138ae96feb59 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.771008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7ce5a-4a74-473d-8584-138ae96feb59 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.773001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 190/378] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:52.778924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.779734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.780235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.805151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:52.806702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:52.815548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 189/379] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:52.847956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7ce5a-4a74-473d-8584-138ae96feb59 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:52.873162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7ce5a-4a74-473d-8584-138ae96feb59 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:52.878097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:52.878922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.879214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.879492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.898402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:52.906153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-3f0ba230-28a8-4cad-be75-5a46e16c091e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:52.907662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 191/380] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:52.913859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:52.918978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320422b-3357-4b01-9d3a-4b893dd3d05e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.919273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320422b-3357-4b01-9d3a-4b893dd3d05e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.920093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320422b-3357-4b01-9d3a-4b893dd3d05e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.921891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 192/381] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:52.924771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ceee0-9824-47a8-85a7-9fb42fddcfb5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:52.930229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.930527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.930806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.939331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:52.940005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.940315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.940596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:52.941349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:52.941658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:52.943285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:52.962411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 190/382] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:52.963446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:52.964681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:52.968719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:52.979192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febd0bb-83f9-4abb-86f9-ab6a57a4e20a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:52.984132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 193/383] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:52.991111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:52.991896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:52.992185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:52.992492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.013321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.015176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.035629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:53.036765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 191/384] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:53.043081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.049708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.054782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401b067-fddd-46da-8910-1b40028ee32e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.060895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914f232-738d-407b-8ac8-900c741e86a5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.065585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.066510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.066795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.067069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.073820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.074498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.074801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.075063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.075849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.076163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.077873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.078354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:53.085384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:53.086556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 192/385] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.093363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.109555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046922b0-784c-4333-8b39-7d0952b7c847 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.110652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 194/386] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.116928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.118238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.119171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.119630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.120136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.121113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.121596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.124105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.133570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 193/387] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:53.138665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d47e5-ce34-4041-b3e9-30e3ada67372 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.139765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.148628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.149428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.149711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.149986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.151213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8317-06bf-4475-b2ae-0951f0469f4d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.156739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.157844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.158387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.158876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.170696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.172863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.176411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.178415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.197960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:53.204140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:18:53.205912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 194/388] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.207654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 195/389] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.213790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.219568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.232171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15daee-377a-4ddf-a216-5f826321492e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.234500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722ea7-e1a3-4aaa-a92f-4f8b3b1a4286 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.239451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.240435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.240946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.241483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.242516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.243066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.244286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:53.244286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:53.244286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:53.245991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.252920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.253600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.253890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.254170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.254905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.255215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.256925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.274316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 196/390] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.289973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.292847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 195/391] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.305827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bea75-55a0-4d30-b026-1922635126da admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.309863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.316936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.318085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.318569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.319991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.331085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694fdd-81db-4cd8-b619-28af83112326 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.335484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.340359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.340733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.342457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.343955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.344522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.361682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.363478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.365422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 03:18:53.367121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 197/392] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/users/glance => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.374147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 196/393] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:53.375200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.381684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.391287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05063-0eb1-4928-afd0-e63a15f46030 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.393128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72430-92ca-45a0-a602-dc35a4d80118 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.401609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.402490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.403726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.404615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.405096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.405610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.406295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.406638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.407698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.409054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.410906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:53.410906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:53.410906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:53.413922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.437113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.439429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.470945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:53.477116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 197/394] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:53.484003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.492519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 198/395] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.499652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23f137-7ef7-4b29-9cb5-2996e49f0e90 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.500231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.505046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.505939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.506472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.506975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.508235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.508741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.510578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.523692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c764-3b72-49b4-83c5-6796f5098d30 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.524622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 198/396] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.529124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.530774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.534731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.535261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.536492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.547904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba445a-04f1-4756-8088-6be4140c7d25 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.554949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.556842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.557886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.558966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.559465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.560450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.581003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.583513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 199/397] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:53.583707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.586262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.603873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c7354-c25d-44ad-8bc9-9029c8869bdc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.608665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:53.613704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.614490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.614828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.615110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.616903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 199/398] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:53.624373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.626974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.629135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.638924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091beba-aca8-4532-8746-d149f0289faa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.648946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:53.650492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 200/399] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.657959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.660874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.661547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.661839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.662123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.662928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.663258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.664279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:53.664279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:18:53.664279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:18:53.665411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.668435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea736f-830b-4752-9625-459c2b23270d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.673701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.674334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.674673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.674949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.675663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.676056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.677718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.697872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 201/400] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:53.703959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.708143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 200/401] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:53.712977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.723452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757baa89-054b-437b-b103-dc10b1456967 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.729959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b67b-9045-4ecf-bdba-d86084f60d51 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.733315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.735124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.735418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.735695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.738661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.741073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.741379 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.741724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.743108 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.743426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.749281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.752030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.754071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.764677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 201/402] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.774149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:53.775802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 202/403] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:53.782949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.793642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6c7ef-3af5-4508-87fa-8099fe6bc69c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.798510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.799115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.799402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.799680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.800509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.800872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.802704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee72c04-5dea-4a80-bbc1-c53387736436 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.816081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 202/404] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.822895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.829896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcddb6-626b-4104-99b2-4424d0bf3ec3 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.830188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcddb6-626b-4104-99b2-4424d0bf3ec3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.830475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcddb6-626b-4104-99b2-4424d0bf3ec3 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.832439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 203/405] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:53.834717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672b1c-94ba-4b20-a42d-46a23cf78325 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.839743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.840626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.840962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.841885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.842573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2de9-f4de-4b1c-a751-d08f31ed1bbc None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.842869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2de9-f4de-4b1c-a751-d08f31ed1bbc None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.843021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=412b07d25ead4bcdb8bf64c0bf8726b9) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:53.843157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a2de9-f4de-4b1c-a751-d08f31ed1bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.843419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:53.845678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:53.852503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 203/406] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/role_assignments?user.id=412b07d25ead4bcdb8bf64c0bf8726b9&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:53.879677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a18a2de9-f4de-4b1c-a751-d08f31ed1bbc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:53.879677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a18a2de9-f4de-4b1c-a751-d08f31ed1bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:53.896544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 204/407] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:53.946421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:53.958604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f6871-7064-4fc4-897a-d8a86ceb8b94 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:53.963448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:53.964338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:53.964627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:53.964903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:53.986517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:53.993796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:53.995343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 204/408] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.002395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37e3c-c91b-45fc-ba69-9f6018ee3dc8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.002614 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.003164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37e3c-c91b-45fc-ba69-9f6018ee3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.003654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa37e3c-c91b-45fc-ba69-9f6018ee3dc8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.006014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 205/409] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:54.012957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.013746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.014231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.014724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3d9c7-b98c-432a-bf3d-0ea9d9f77a2a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.019560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.020271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.020564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.020977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.024223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.024223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.024223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.034563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 205/410] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:54.048795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.051334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:54.052587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:54.059980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbd76e-44f6-4b86-913a-9db15f027e5e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.065035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.066122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.066412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.066739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.074880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 206/411] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:54.079693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.081682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.099575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:54.101142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 206/412] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.107729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.110978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.119098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2fd6f-7357-458f-90de-3309f6077e74 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.123619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa84ec-d00b-416b-b86c-d0d8166b07c9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.126917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.126917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.127134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.127334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.128473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.128579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.130552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.137002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.138074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.139083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.139558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.145230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 207/413] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.151221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.152875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:54.160086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:54.161831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 207/414] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.163141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a279f8-ba63-413f-9608-e20ab48c2dde admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.167785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.168495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.169094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.170213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.170703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.179801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.182219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.190497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035974-86de-4694-b33d-09c4c2eb887c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.197764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 03:18:54.199676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 208/415] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:54.204243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.204243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.204243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.204243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.204587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.204587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.205935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.207059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.217482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7f14-c07e-4037-ba7b-b883fc97b3aa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.222605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 208/416] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:54.223161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.224111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.224704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.225179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.226277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.226791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.228555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.229356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.246694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795558-8fdc-4a44-ab8c-a3cf30ec327d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.249691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 209/417] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.256335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.264879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.265698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.265986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.266266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.269323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a166bda-d6d5-41ef-a3f9-51d746441bad admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.274072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.275055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.275553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.276027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.282910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.284572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.285583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.287625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.298122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 210/418] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:54.304448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.310322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:54.311354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 209/419] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:54.314190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31860374-777d-4138-a6fb-9e6f6ed31b66 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.317325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.319584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.320790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.321277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.321794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.330164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9246dc-d865-413c-8102-5cc1aa5ebec1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.334153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.336458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.345876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.346827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.346827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.347117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.347844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.348156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.349778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.356740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:54.359274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 211/420] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.365817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.373929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 210/421] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:54.377535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924ecb7-77c5-484f-8a4e-a9da662afc5f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.380266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.383534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.384579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.385187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.385677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.386670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.387234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.389737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.394950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c209fd-180a-43fa-9cb0-2a9b2b1d5a27 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.403367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 212/422] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.409848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.417564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.418377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.418704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.418997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.421988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5605-0408-441e-9ca0-e273b000c982 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.433739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.434524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.434810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.435150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.435769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.437842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.444311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.446442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.454616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-623b8fb7-8b27-49d0-b8fe-51c169d50ded admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 03:18:54.455985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 211/423] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/users/neutron => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.457379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e666cc-0895-4065-8382-490a922305ce None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.457837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e666cc-0895-4065-8382-490a922305ce None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.458280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e666cc-0895-4065-8382-490a922305ce None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.460227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 212/424] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:54.465508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e666cc-0895-4065-8382-490a922305ce None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.473190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-9b0388cd-0202-49d0-80b5-3e919cecb3b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:54.474405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 213/425] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.475719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.475944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.476387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.479638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e666cc-0895-4065-8382-490a922305ce None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.484403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.485270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.485745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.486240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.487248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.487746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.489838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.494924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:54.496118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:54.504972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 214/426] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:54.512215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.515373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560afbe9-e81a-47b2-b6e7-430be31177c1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.517428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 213/427] 10.222.0.21 () {56 vars in 1161 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.523206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.529396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.530057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.530693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.536934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.536934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.536934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.536934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.537195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df892239-1e42-4689-ab55-2f00bf394dc7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.539132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.539974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.540487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.540955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.549024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.551012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.554341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 215/428] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.557607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.561477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 214/429] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:18:54.562468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.571652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04275c-7e12-44bd-84f8-b0442b70587d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.572750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e9667-2102-4c1a-ad0f-1143a6a63a6f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.577253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.577656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.578334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.578523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.578858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.579142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.579367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.579991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.581026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=175949d4ebc945cdb0b0a43c8b223f16) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.581531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.583521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.589121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 215/430] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/role_assignments?user.id=175949d4ebc945cdb0b0a43c8b223f16&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.590094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.590484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.592955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.601294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75b010-fd4a-4d92-9e36-dd321fccfc75 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.606276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.607478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.607962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.608465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.611089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:54.612678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 216/431] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:54.619024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.620453 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.623077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.629883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e5f81-ee4d-4fb8-a500-982a275f34b5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.635239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.635980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.636314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.636651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.637522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.637838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.639722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.644005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:54.645754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 216/432] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:54.655118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.660799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 217/433] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:54.665219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841831e-3ece-4c47-b484-9c4c5a118ae0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.667295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.684227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.685839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.687416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.687913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.689113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.689929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.692386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1e30d-1d84-4de5-a14e-eba9ef1f028b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.694469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.704654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.706355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.707289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.708340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.709266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.712614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1350e96-29d3-4928-bd22-55fd2a596c46 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.719958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 217/434] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:54.726497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.737416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8621396-ed52-4f76-80bb-592a6166dad8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.743102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.744320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.744793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.745792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.754959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.757416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.773848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:54.775557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 218/435] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:54.783437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.794438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8bac9-69ab-48bf-840f-a37bdaebea4b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.800855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.801883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.802354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.802820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.803841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.804399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.805619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:18:54.805619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:18:54.805619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:18:54.807165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.826802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 219/436] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:54.828342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 218/437] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:18:54 2021] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:18:54.843296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:54.858523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49cd35-37fd-493b-b81a-51178d971561 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:54.865231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:54.866221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:54.866691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:54.867182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:54.868247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=128aae7c4c7b4d2a9bfc0eb65e1c5734) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:54.868792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:54.870975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510dd44-dd7b-4bbd-bcd9-23170de5c4a7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:54.880773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 220/438] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:54 2021] GET /identity/v3/role_assignments?user.id=128aae7c4c7b4d2a9bfc0eb65e1c5734&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:56.312558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114334d8-c35f-4f79-8fce-8283604e11d7 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.313558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114334d8-c35f-4f79-8fce-8283604e11d7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.314069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114334d8-c35f-4f79-8fce-8283604e11d7 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.316377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 219/439] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:56.322196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabadda-9d6f-4ddd-abb2-6811da09deeb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.323100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabadda-9d6f-4ddd-abb2-6811da09deeb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.323582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabadda-9d6f-4ddd-abb2-6811da09deeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.353423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-deabadda-9d6f-4ddd-abb2-6811da09deeb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:56.354680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-deabadda-9d6f-4ddd-abb2-6811da09deeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:56.363316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 221/440] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:56.399825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114334d8-c35f-4f79-8fce-8283604e11d7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.420868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114334d8-c35f-4f79-8fce-8283604e11d7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.425857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.426915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.427400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.427872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.433038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4589-03a2-4564-ba1f-fd6852a6ba40 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.433347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4589-03a2-4564-ba1f-fd6852a6ba40 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.433624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc4589-03a2-4564-ba1f-fd6852a6ba40 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.435474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 222/441] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:18:56.441607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.441893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.442172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.453130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:56.460319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:56.461739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 220/442] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:56.461845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:56.467260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:56.468306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.470878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 223/443] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:56.508071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.520783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01063b-832d-4d25-9b66-7537a54bc58c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.538104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.538945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.539241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.539521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.558406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:56.569739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:56.571338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 224/444] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.577910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.589659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83d5bb-b92e-4de6-8910-d29bd2e20835 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.592800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d143d28-55a0-41a5-a1d8-d7d351290332 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.599751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.600439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.600726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.601008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.602410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.602726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.604478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.605180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.605466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.605742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.606487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.606797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.607946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.611600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.623515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 221/445] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:56.630402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 225/446] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:56.632535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.636608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.647303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adffde0-de5c-4587-8503-4a45c4d356b8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.649769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce6d1-ff3a-4f3b-a351-66d63e7a19f5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.652034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.652949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.653303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.653588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.662044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.663206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.663498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.663776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.665879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.667974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.686150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:56.686889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.688219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 226/447] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.692298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.694835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.706195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dbb3-7561-4505-b059-33042fa9fc96 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.717289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:56.721872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.722799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.723301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.723763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.724714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.725280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.727057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.728544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 222/448] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.734601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.749002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 227/449] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:56.755135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.756585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb96e62-09c9-4dba-b7d0-4011cd7f89f4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.766691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405e18-40e5-4712-8d31-b03aa976b022 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.771899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.772866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.773235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.773532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.773824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.774109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.774249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.774720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.774882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.775153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.776792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.783828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.786675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.801533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:18:56.803472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 228/450] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.808240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 223/451] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:56.809878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.810867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.820575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5def47d-c12a-451b-9d89-5961be1561f9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.826297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.827218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.827712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.828233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.829410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.829909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.830533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e113-d98d-4097-a1fa-0450e0d88c5e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.832364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.848874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.849963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.850249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.850528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.853528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 229/452] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:56.859541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.870309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca638f-f5a4-4da4-977a-1db829a7da8a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.873283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.875392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.876542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.877570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.878080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.878544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.890435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.892664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.904268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 03:18:56.905781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 224/453] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/users/glance => generated 84 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.910798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:56.911677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.912810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 230/454] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:56.918729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.929266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa6a15-3b2c-4c28-bd08-9e4220e9594d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.932917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517c84c-8f6c-4e16-b3df-70ee6a9b8d4f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.934583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.936025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.936528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.937146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.938204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.938701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.940847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.944828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.945496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.945782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.946063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.946906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:56.947219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:56.949084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:56.955139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 231/455] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:56.962145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:56.978009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ee29b-cbb8-4f61-ac86-c69b1639833e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:56.988000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:56.990907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 225/456] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:56.991181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:56.991726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:56.992279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:56.998530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.002344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.004629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.018496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95173-562b-47b5-a34d-b1370c9e3091 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.020313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:57.022025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 232/457] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:57.028311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.037014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.037897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.038194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.038488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.040007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b8b97-9f75-47f6-a304-19562c6fa1d3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.044982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.046133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.046614 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.047124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.048116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.048639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.051141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.064646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 233/458] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:57.071105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.081673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.081673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.097179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dbd05-ec07-40f1-93a5-f910689c4eb1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.111842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.112791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.113065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.113342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.119316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:57.123810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 226/459] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:57.132231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.145323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=72464249c58f4f278dbea091c17c192a, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.147991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d739d-9364-4075-aab7-2d5bc303b10b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.152272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429e006-67a3-41d5-a963-33b3928c7787 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.158190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.158852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.159138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.159419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.160240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.160553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.162194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.175461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 227/460] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.181652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.191918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734795-aa52-4a86-a5aa-782621399e90 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.196691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.197479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.197765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.198044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.205322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.207323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.221168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:57.222769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 228/461] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:57.229046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.237552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 234/462] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:57 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:18:57.247319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34360c6-92b4-43bc-a131-0ab002590e76 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.328175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.328965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.329217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.329500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.330356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.330676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.332593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.337950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccd75-5f8e-4d86-9367-414c8ae46f0f None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.338441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccd75-5f8e-4d86-9367-414c8ae46f0f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.338535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ccd75-5f8e-4d86-9367-414c8ae46f0f None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.340510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 235/463] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:57.354203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.354530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.354768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.355034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 229/464] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.362304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.372420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d517b89-81a7-4fcf-9268-802d064c5686 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.377477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.378441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.378783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.379065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/412b07d25ead4bcdb8bf64c0bf8726b9/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.393451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:57.394592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:57.397145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=412b07d25ead4bcdb8bf64c0bf8726b9, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.399950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa979a0-23df-43b7-a5fa-c79e3e2e7b49 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.409418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 236/465] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:57.433501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.443341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517f55-60c2-40c7-9d86-66996c2979dd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.448948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.449772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.450061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.450373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.462743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:57.475229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:57.475229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 237/466] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:57.478007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 230/467] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:57 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/412b07d25ead4bcdb8bf64c0bf8726b9/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:18:57.482415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.492421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e7c8-e830-4490-9834-ad73f4109470 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.512287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536948-0fb0-436f-a909-da209d8fffd6 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.512592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536948-0fb0-436f-a909-da209d8fffd6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.512870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536948-0fb0-436f-a909-da209d8fffd6 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.516396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 231/468] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:57.521669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.521949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.522232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.546647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:57.546647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:57.573335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.574647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.574937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.575224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.576494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.576818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.578876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.595269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 238/469] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.597593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.610465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacf451-fa14-4ea5-be4c-dd49a7ed9f04 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.616385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.617443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.617737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.618044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.625920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 232/470] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:18:57.634860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.637182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.655047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.655834 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:57.657603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 239/471] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:57.664313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.665905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbf910-f900-43b9-8eba-5fa593726a92 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.670605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.671634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.671926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.672841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.676388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec9e69-cbdd-4d65-b86f-adbcb60f6d2d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.681561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.682601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.683100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.683600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.684652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:57.684765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.685821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.687760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.693035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:57.696276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 233/472] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:57.709279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.710607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 240/473] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:57.721175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.728033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e270d-d682-4039-b25f-8dc3aa16f0a9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.733455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4506a5-15fe-4234-816f-1a0497cfd9a4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.736558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.737575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.738080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.738361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.739138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.739449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.741220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.751911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.752766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.753046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.753315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.758601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 234/474] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.765437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.765586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.767571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.777339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30f9f4-06b0-4039-b576-c71f17480f84 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.783035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.784038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 03:18:57.784445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.784930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.785439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.785543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 241/475] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:57.791370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.801347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.802709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a9fdf-6d3e-425b-a913-5d14fd8405d1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.805683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.808615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.809277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.809558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.809831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.810692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.810999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.813500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.824312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0609e991-ada2-4891-b134-08df933d0f4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:57.826357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 235/476] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:57.827649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddda1b-3e1f-46d7-be26-bd3510058814 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.827936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddda1b-3e1f-46d7-be26-bd3510058814 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.832079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 242/477] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.833265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddda1b-3e1f-46d7-be26-bd3510058814 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.834956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 236/478] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:57 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:57.836008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.839459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddda1b-3e1f-46d7-be26-bd3510058814 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.848448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64d36a-5c1a-4a6a-8e50-ed5b331652d5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.853883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.854454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddda1b-3e1f-46d7-be26-bd3510058814 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.854576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.854818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.855099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.855868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.856177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.858400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b18fe9-9672-4334-854d-5c6cfca17ac1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.859423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.860215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.860511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.860794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.871049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.872399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 243/479] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.874375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.874667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.874944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.876818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.895744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:57.896418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:57.897015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:57.897944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 237/480] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:57.898776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.908873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a50ab-cb30-4136-b396-1768db7eb757 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.911285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 244/481] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:57.912111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.922292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.923179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.923464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.923736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.934977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75f26b-b705-449d-b7c2-960faa7b0b8c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.939035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.940887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.941294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.941590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.941948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.942191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.942965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.943487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.945757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.955838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 03:18:57.957329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 238/482] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:57.958103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.958778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 245/483] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:57.964367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:57.972922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46477f8-1d1d-4542-89ad-8566b19ec8da admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.975157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392247-acbf-4f53-94fa-1ece98f9089e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:57.977592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.978429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.978644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.978924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.979854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:57.980535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:57.981029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:57.981307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:57.983137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:57.983493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:57.985492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:57.998832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:18:58.006701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:18:58.008610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 239/485] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.008993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 246/485] 10.222.0.21 () {56 vars in 1161 bytes} [Tue Aug 10 03:18:57 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:18:58.009852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.010339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.025567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31ee2c-e227-41e2-b33e-ce12780a0c8b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.025835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6731-f406-4419-ad95-45b29d23bfcb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.030579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.031064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.031360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.031695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.031980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.032676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.033147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.033616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.042125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.042667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.045084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.045289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.059561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:58.061031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 240/486] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.061684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:58.062280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.062824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 247/487] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.068572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.073631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11b6b6-fc21-4e40-8378-1d43a469baa8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.079348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118c4b9-916d-4636-add7-e14859378929 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.079819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.080942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.081418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.081903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.082966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.083477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.085274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.086952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.087531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.087865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.088149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.089095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.089452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.091499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.096053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 241/488] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.097061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.104014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 248/489] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.108494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19196b-8c0c-4acc-b465-12907988ce98 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.113040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.114350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.115209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.115738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.116256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.117301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.117810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.120452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.123587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab1ef0-2212-47ec-b543-5298b7fe9431 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.128104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.129035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.129378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.129716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.134965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 242/490] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.135946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.146476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.147094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740a733-78c3-43f3-a855-d41d6bbb4cef admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.148471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.152391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.153488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.154018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.154481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/175949d4ebc945cdb0b0a43c8b223f16/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.165746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:58.167277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 249/491] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.168242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.171800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=175949d4ebc945cdb0b0a43c8b223f16, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.175403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.178486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece6e12-0aa3-4a3f-a833-aaa12848cf7d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.183837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.184683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.184996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.185303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.192179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.194272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.207505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:58.208773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 250/492] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.213966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.223558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8c889-7c35-4af4-9c2d-2e9539ccb4e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.227933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.248716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.249118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 251/493] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.249118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.257522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dbfa-221a-43be-998c-3bbca6da08e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.262129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.263563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.263563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.263563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.264061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.264392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.266194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.278452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 252/494] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.279573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.294345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2be37-8f92-4e62-b147-2bbc4f376974 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.299659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.300482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.300769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.301044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.308434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.310554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.324228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:18:58.325593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 253/495] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.330611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.340381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ad18-5237-4b06-b9ac-29ccbc341849 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.347700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 243/496] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:58 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/175949d4ebc945cdb0b0a43c8b223f16/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:58.349016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.457012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.457830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.458113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.458388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/128aae7c4c7b4d2a9bfc0eb65e1c5734/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.484245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e019-b3e7-41a4-8460-695cc90051c2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.490424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=128aae7c4c7b4d2a9bfc0eb65e1c5734, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.494854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.495609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.495897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.496525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.497920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.498648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.501478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.503814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.526934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 244/497] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.537321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.548873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7f64-7514-4bc0-86dd-3489375aefb1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.553841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.554546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.554829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.555187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.563829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.565657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.577481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 245/498] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:18:58.583864 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.593820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b0b00-c748-4ba0-bf12-56b4d468b3a6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.600088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 254/499] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:18:58 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/128aae7c4c7b4d2a9bfc0eb65e1c5734/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:18:58.787194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.787985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.788288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.788606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.799501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.801365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.818505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:18:58.820073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 246/500] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:18:58.828565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.839022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae1b20-5457-4052-a0bf-0333cd4c15a7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.843727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.844469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.844802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.845081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.845819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.846125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.847749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.861915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 255/501] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.870024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.880709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb037-bcb2-4d8f-983f-3681e9de6c0b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.885558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.886338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.886674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.886949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.894867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.896938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.909899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:18:58.917468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.928391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa96a-eb9b-44f6-81b8-88fae31bf673 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.930426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 247/502] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:18:58.935507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.936280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.936519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.936797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.937620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.937930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.939883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb682f-f17d-46f5-9f62-70216ccaa97a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.952871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 256/503] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:58.959538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:18:58.970861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8af1f-5810-4e53-8e33-9853905b0d59 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:18:58.975373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:18:58.976061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:58.976376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:58.976650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:58.977516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=90dad318c8b1444795b9ea36a595d70e) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:18:58.977825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:18:58.979753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acce7d-0cd5-4898-a8aa-131e92d5d84c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:18:58.985903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 248/504] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:18:58 2021] GET /identity/v3/role_assignments?user.id=90dad318c8b1444795b9ea36a595d70e&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:18:59.943394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb746-bf21-4add-a08c-814e267cfa2b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:59.943945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb746-bf21-4add-a08c-814e267cfa2b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:59.943945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb746-bf21-4add-a08c-814e267cfa2b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:59.945986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 257/505] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:59.952148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:59.952587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:59.952778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:59.975861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:18:59.977066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:18:59.983846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509487-c3d6-4faa-a328-0310887f9552 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:59.984135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509487-c3d6-4faa-a328-0310887f9552 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:59.984433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509487-c3d6-4faa-a328-0310887f9552 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:18:59.986319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 258/506] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:18:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:18:59.987999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 249/507] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:18:59.992300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:18:59.992673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:18:59.993061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.015434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.024658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:00.025868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:00.030416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e5c9d-1eb4-4a0d-84f6-6ef5ac1fdf07 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.038745 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.039540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.039826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.040104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.043157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 259/508] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:18:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:00.057521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:00.068469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:00.069963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 250/509] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:00.076700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.089191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69a730-040d-4856-a501-75705ec82d58 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.098856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.099533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.099821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.100101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.100973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.101282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.102890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.109180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.114523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 260/510] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.125494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f798-c6cc-400d-a704-ce2d5d20f3fc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.127850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.130608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.131646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.132168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.132938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.142146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d093f16-0b68-4b30-b7a5-08796f685e01 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.156563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:00.157434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.158548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.159043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.159960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.176678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:00.180553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 251/511] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:00.180754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.182874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.185261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.203322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2c905-83e8-4956-9c89-6a1060c174b6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.215172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.216093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.216712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.217195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.218126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.218660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.221791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:00.222234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.224814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 261/512] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:00.237572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 252/513] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:00.239220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.245170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.249824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c4d8e-06b3-44df-b1c2-d85cb30e1c78 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.254739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.255662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.256138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.256666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.257975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.258156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375de393-04b5-4d51-83a6-451860b04f60 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.258644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.260556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.274567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.275754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.276298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.276768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.283813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 262/514] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:00.292040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.296369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.298683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.314651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f131fd5-d4e8-4cf4-8bd2-b3fd8ef43c60 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.317583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:00.319369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 253/515] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:00.324957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.340238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.340238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.340238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.340238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.340636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8b0b0-04b5-473b-b247-1549aa005bb6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.350258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.350997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.352276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.352564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.353375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.354031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.355299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.358470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.359759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.383251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 03:19:00.386221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 254/516] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:00.386758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 263/517] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/users/glance => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:00.392747 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.394467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.408941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbaa51-95bc-47fe-a5eb-04f8d05a153f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.415289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53786-6a0a-4d63-b231-7dc4a476ca59 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.420052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.420884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.421172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.421452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.430456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.431138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.431421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.431698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.432571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.432885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.434735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.437608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.439622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.460092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:00.462901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 255/518] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:00.476061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 264/519] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.476475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.482629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.494198 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760ead-c774-4cdd-b12b-808eeb08861d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.496756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5a0f3-1cf9-49e2-ac2c-1a0cdd17356e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.504646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.505292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.505579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.505856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.506934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.507586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.508120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.508420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.509264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.509572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.511413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.523168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.527452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.547173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 265/520] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:00.549489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 256/521] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.554065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.560765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.572604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45fd51-0379-429d-8c1b-42e23dd4a688 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.575812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31f7c8-3bc1-461d-aede-d3df5dfdb597 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.582401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.583190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.583478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.583758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.585591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.586234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.586520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.586801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.609885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.609885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.618270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.618270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.636183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 257/522] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:00.646290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:00.648452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.658060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238b43-c301-4a66-9e38-85a10b8016cd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.658925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 266/523] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:00.659769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.670277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c600c-de56-490b-a64b-4f177f45aa4f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.681521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.682385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.682675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.682954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.694723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.695440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.696312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.696609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.698334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.698649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.699898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.702027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.704459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.729492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 267/524] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.731953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.738624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:00.739833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 258/525] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:00.750565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf62ed-4f0f-49f4-9068-b6df1c140cce admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.752109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.765214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.767279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.767566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.767849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.768437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994036e3-1582-470a-bec3-d5c2527cff52 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.777441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.778099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.779797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.780084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.781893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.782213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.784312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.786266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.788745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.810921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 259/526] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.819128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:00.820618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 268/527] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:00.823338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.828316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.837293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7964fa-8bf5-4d48-af2d-c0cde3641f16 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.843851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f143ae-94fe-4038-ac17-e9f2dd4ad2b3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.848327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.850429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.851560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.852542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.853952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.855037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.855770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.857525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.858800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.859693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.860214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.879072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.883058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.887228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 269/528] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:00.896563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.907214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c35d52-2deb-416f-861e-bcea66fe4e04 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.910191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:00.911948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.912429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 260/529] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:00.912651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.918326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.918326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.918326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=412b07d25ead4bcdb8bf64c0bf8726b9) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.918326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.918326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00be6d8-52e8-4b20-9877-03584634a840 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.920532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.923111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 270/530] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/role_assignments?user.id=412b07d25ead4bcdb8bf64c0bf8726b9&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.937730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6bc5-284d-4c21-9f1d-c49c07bd4994 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:00.948468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a8c8-ce5a-453c-ba93-44005709f9f0 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.949014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a8c8-ce5a-453c-ba93-44005709f9f0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.949356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136a8c8-ce5a-453c-ba93-44005709f9f0 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.951855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 271/531] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:00.954192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:00.954876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.955168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.955453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.956345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:00.956663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:00.958678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:00.958834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:00.959158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:00.959541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:00.977887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 261/532] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:00.980491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:00.982329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:00.984820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:00.999761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50839526-47e7-4a57-8604-4c8072f7176c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.005780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 272/533] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:01.014638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.015320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.015606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.015886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.016822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.017146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.018997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.028437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 262/534] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:00 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.033019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.043015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784fbcd-b1a8-43bb-b225-e6ba4ba9295a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.048500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.049386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.049721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.050059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.080044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:01.100151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:01.101837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 273/535] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.117649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.138593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa35f77-08f0-4f6f-8635-06a452b53c5e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.151655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.152389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.152679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.152957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.153817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.154134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.155815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.172667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 263/536] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.178895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.194097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118004d7-82aa-4e3d-9f20-789e165264bd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.204753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.205723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.206102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.206469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.223937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.225956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.246908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:01.248977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 274/537] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.255560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.267655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d28b-0732-4c32-845c-a9194c6d7f02 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.274423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.275333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.275768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.276191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.277109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.277644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.280461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.298928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 264/538] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.306025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.318608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d9492-ce41-49b8-8e14-9819711a02b4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.326316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.327130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.327410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.327682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.338273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.340452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.355550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-01b23cf3-90f2-47e1-9dcf-adf04670193a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 03:19:01.357263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 275/539] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.366545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.369073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c026-9d05-4f98-b9f1-6a57749c3e2f None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.369464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c026-9d05-4f98-b9f1-6a57749c3e2f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.369844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c026-9d05-4f98-b9f1-6a57749c3e2f None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.371846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 276/540] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:01.378408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.378870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.379295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.381944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6251-5ba2-4aba-8352-5c7f0a707c21 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.389129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.389129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.389354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.389594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.390436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.390752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.392810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.400541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:01.401929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:01.417631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 277/541] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:01.419799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 265/542] 10.222.0.21 () {56 vars in 1159 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.426013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.437022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f99dd-335a-4219-9441-70b28b7b4732 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.448981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.449993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.450421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.450952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.465427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.468228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.482574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 278/543] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:19:01.487500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.489227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.499015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41f30d-1182-4560-886c-f7bdfedbbc50 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.504002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.504143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283f539-5b35-4704-93d2-a3d0e11ac40e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.505127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.505604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.506013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.509887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.510688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.510975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.511254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.519890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.521945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.522790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:01.530349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-1887a646-041c-49a8-9319-6979c39a44a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:01.531878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 266/544] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.537550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc632b-8996-467d-8b48-8c9d75a76a21 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.538015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc632b-8996-467d-8b48-8c9d75a76a21 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.538434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc632b-8996-467d-8b48-8c9d75a76a21 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.539657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:01.541767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 279/545] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.544368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 267/546] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:01 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:01.546958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.547731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.548162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.548613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.557150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22970b1c-73a2-4331-a07a-f9ecc852921a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.561850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.565531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.565531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.565531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.565531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.565531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.565910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.568713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:01.570094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:01.579422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 280/547] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.579422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.584489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 268/548] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:01.585585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.586360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172dd96-f3d5-4f02-9738-27e0551f8885 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.590917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.591640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.591929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.592237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.593146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.593463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.595065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.596970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae098bed-2bf1-45a7-8e97-45d4f19c93d2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.601926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.602937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.603397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.605656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.608230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 281/549] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.615764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.617524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.620413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.628875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7970681-09eb-40c0-a261-9b6731cf271e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.633953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.634842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.635181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.635469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.639611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:01.640959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 269/550] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.641853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.649332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.651369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.655497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc9ae0-527e-4a48-8721-1406fb0fa499 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.660365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.661256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.661677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.662084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.665435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:01.672285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 282/551] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:01.672285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.683356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75551cc-94c1-4bde-a111-96f935562d14 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.684495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:01.691463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.692255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:01.692478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.692946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.693350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.693608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 270/552] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.694438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.694661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.695268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.697113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.704240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebce4d-61cf-420f-8335-5470071522b6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.709615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.710231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.710570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.710853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.711488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 283/553] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.712438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.716734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.717077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.719045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.723012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c451b5-7ef4-4339-9f85-088a53c803b2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.727638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.728931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.729364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.729777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.731085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.732355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.734012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 271/554] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.734204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.740028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.753132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 284/555] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.753547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1448c8d-548c-4682-b2a5-e2fcdd6e295e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.754230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.764017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.765046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.765455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.765848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.770201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27bc1a-ec9c-4670-9b09-b43e4fb30ee7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.774557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.774746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.775378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.775664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.775945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.776814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=175949d4ebc945cdb0b0a43c8b223f16) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.777126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.777397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.778967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.784856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 285/556] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/role_assignments?user.id=175949d4ebc945cdb0b0a43c8b223f16&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.785621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.792662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 03:19:01.795961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401ef2e-9772-45bc-8567-28d92ca45870 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.800112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 272/557] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.801648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.804352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.805161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.805445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.805717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.813547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02786d-592c-4fa6-a98c-e352b9f4e7b9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.818499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.818762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.819624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.820063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.820390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.820560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.821749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.822171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.824384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.852521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:01.856299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 273/558] 10.222.0.21 () {56 vars in 1161 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:01.861203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.861422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 286/559] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:01.870077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.881171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107223f-8bb4-4228-82e2-0d8e78903866 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.885344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecc674-c61a-4818-9ba1-c185a82114da admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.892249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.892249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.892249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.892249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.892611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.892611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.892611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.904280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.905939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.906514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.906759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.909844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 274/560] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:01.915964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.926390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.928023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.935431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ede1c-1bfe-4f22-9036-096d8e23ca7b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.940389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.941492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.941779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.942056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.951762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 287/561] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:19:01.952298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.954351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:01.959993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.970438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:19:01.971897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 275/562] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:01.978308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:01.978629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415433-709f-4c2b-b04f-8fe7efecf51d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.988438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995de72-a1ff-4b51-8597-993c1ee52bf9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:01.991089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.992104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.992419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.992855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.993135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:01.993789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:01.994078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:01.994354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:01.995390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:01.995700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:01.998488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.008328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.010099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.018396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 276/563] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:02.032462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:02.034184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 288/564] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:02.035358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.042601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.050244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64f1f4-5664-4d16-9684-449dc804013d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.054405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887fc3-9756-4dc9-b539-637026fbecdc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.056047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.057347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.057526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.057979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.065493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.066319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.066789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.067172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.068527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:02.068951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.071338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.072099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.074233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.092297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 289/565] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:02.098445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.099808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:02.102079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 277/566] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:02.111732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.112540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364951a8-b00f-441d-8d3d-94e1896fc377 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.117190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.118035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.118325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.118600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.126937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.128941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.134887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a0552-443f-4783-94bd-1d526b230a38 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.142566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:02.144038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 290/567] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:02.150074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.152036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.152739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.153091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.153313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.154594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:02.154899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.156527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.160965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db945d0c-626f-4731-afb9-89d9c3d7ea4e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.166084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.166738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.167022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.167293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.168071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:02.168405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.170804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.179527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 278/568] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:02.186684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.189548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 291/569] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:02.195838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.206135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b7cd-3189-4b5e-b705-09a142ee017f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.210561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d5cd7-935f-4024-bc4d-1ee9e0f6a231 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.210785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.211431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.211710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.211988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.212840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=128aae7c4c7b4d2a9bfc0eb65e1c5734) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:02.213150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.214977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.221767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 292/570] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/role_assignments?user.id=128aae7c4c7b4d2a9bfc0eb65e1c5734&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:02.226349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.227167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.227468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.227733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.240978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.242963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.264706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:02.266137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 279/571] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:02.272910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.289644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcabd4-314a-4d52-91ed-22438a49b4dc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.302218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.302918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.303204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.303477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.304320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:02.304634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.306541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765191-2ded-4dda-b149-0738cde0eb90 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.324644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 293/572] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:02.333505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:02.349691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ba616-8572-480c-8f06-33e88198667d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:02.364979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:02.365889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:02.366187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:02.366449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/90dad318c8b1444795b9ea36a595d70e/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:02.388429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=90dad318c8b1444795b9ea36a595d70e, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:02.391076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a0cc3-881b-4389-8680-839e8bd25a20 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:02.471728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 280/573] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:02 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/90dad318c8b1444795b9ea36a595d70e/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:03.606352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5036-8647-4f4e-ac57-c276ae23ad7b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.607110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5036-8647-4f4e-ac57-c276ae23ad7b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.607110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa5036-8647-4f4e-ac57-c276ae23ad7b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.608943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 294/574] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:03.628757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a88a2-33c5-4d39-ae3c-55384073322b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.628757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a88a2-33c5-4d39-ae3c-55384073322b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.628757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a88a2-33c5-4d39-ae3c-55384073322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.652082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-187a88a2-33c5-4d39-ae3c-55384073322b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:03.654169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-187a88a2-33c5-4d39-ae3c-55384073322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:03.733107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 281/575] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:03.777234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa5036-8647-4f4e-ac57-c276ae23ad7b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.792394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d8-8115-4040-8d30-467353856d45 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.792969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d8-8115-4040-8d30-467353856d45 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.793509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d8-8115-4040-8d30-467353856d45 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.796146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 282/576] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:03.796425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa5036-8647-4f4e-ac57-c276ae23ad7b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.801534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.801828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.802111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.804249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:03.805026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.805306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.805641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.821398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:03.822599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:03.829231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:03.832049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 283/577] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:03.835930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:03.837452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 295/578] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:03.843378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.853039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206b1c6-d4f1-436a-814c-011878b2c70f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.865027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:03.865643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.865933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.866211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.866988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:03.867300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:03.868976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:03.885673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.886988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 284/579] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:03.893439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.896268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d9b96-17a0-446a-b808-f80af593ea41 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.901231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:03.902024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.902314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.902592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.914677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a675f4-7f25-496a-86ba-fe82fb239167 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.915236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:03.917112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:03.935416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:03.936903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:03.937109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 296/580] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:03.937728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.938012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.938294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.943781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.955518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77358f4-ad8c-4e99-b23e-900d1b5f0035 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.961185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:03.961850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:03.962190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:03.962473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:03.963198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:03.963561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:03.965349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:03.965537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:03.967242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:03.979121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 297/581] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:03.986136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:03.996919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b453-eaaa-4db0-a1b4-6f7637ac857f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:03.999703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:04.001947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.002620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.002936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.003211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.003971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.006123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.009281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 285/582] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:04.015428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.031335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d2cd7-794f-4703-9d40-be8f22ae704d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.036058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.036734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.037148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.038925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.038925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.038925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.040189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.054690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 286/583] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:04.060559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.070954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ecf64-dce5-4f0e-9c05-9f035d773c2e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.076659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.077535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.077821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.078100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.090095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.090095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.105652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 298/584] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:19:03 2021] POST /identity/v3/users => generated 254 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:04.109538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:04.109538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 287/585] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:04.115737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.128999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06d558-5ebb-457f-a759-080f3c270276 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.134569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.135257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.135548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.135829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.136724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.137040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.139535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.159705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 299/586] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:04.165936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.176660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259c25a-22bc-456e-a627-624e6fcb611b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.185705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.186366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.186654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.186932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.200831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.202594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.218808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 288/587] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:04.224979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.235034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6798b-6300-43e0-8eee-f837aecf7926 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.244808 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.245629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.245912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.246192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.258095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.259940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.294697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:04.295937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 300/588] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:04.301993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.317791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e99ad-7829-4849-b7c8-8d6d7338cc7c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.334036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.334724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.335008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.335285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.336020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.336426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.338039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9f74-82fb-4063-bfd7-ee37e0d7c3c5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.360470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 289/589] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:04.366323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.383662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9feb-6df2-4766-a5b6-d911fe4ecda4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.403164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.404663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.404956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.405324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.415520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.417615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.442166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:04.443669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 301/590] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:04.448575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788c90-9228-4f55-bbe9-1fef4b06e761 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.449013 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788c90-9228-4f55-bbe9-1fef4b06e761 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.450114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788c90-9228-4f55-bbe9-1fef4b06e761 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.450335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.451868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 290/591] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:04.458744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.459285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.459768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.464469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1c7b8-8db5-4586-bb40-34f41d0f8a97 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.470070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.470351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.470611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.470893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.471680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.473198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.473869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.486183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:04.487681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:04.488022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 302/592] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:04.494432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.504316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 291/593] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:04.505411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661017a2-7df8-4c90-8325-2bbe38cf2263 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.510852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.511505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.511847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.512137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.513294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.513668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.515624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.521928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 303/594] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:04.525538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.538459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e439-d0ce-477a-b68e-736786a40a66 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.543822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.545130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.545657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.546253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.547122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.548441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:04.548441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:04.548441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:04.549782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.568747 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 03:19:04.570338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 292/595] 10.222.0.21 () {56 vars in 1151 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:04.577683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.598131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c5d-2457-46da-a1fe-2a844e02d0af admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.605367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.606058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.606347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.607154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.607888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.608245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.609991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:04.609991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:04.609991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:04.610893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650020b-ca00-4fd7-817f-efb1cb2e34df admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.616604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 304/596] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:04.622504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:04.633442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84172a9b-8ebc-491a-9c08-c12757cd81b5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:04.639689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:04.640452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.640743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.641080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.641868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:04.642183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:04.643274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:04.643274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:04.643274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:04.644247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04594b6-bcd7-4afa-aacd-82daa813ca7f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:04.652142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 293/597] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:04 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:04.978066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01381-71b6-45a4-be42-0bad9d56b9c8 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.978788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01381-71b6-45a4-be42-0bad9d56b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.979334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e01381-71b6-45a4-be42-0bad9d56b9c8 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:04.981382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 305/598] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:04.987781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:04.988362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:04.988858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.011618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:05.013256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:05.025724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 294/599] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:05.050408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01381-71b6-45a4-be42-0bad9d56b9c8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.063855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e01381-71b6-45a4-be42-0bad9d56b9c8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.068660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.069719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.070213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.070698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.071562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.072795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:05.072795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:05.072795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:05.074105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.087353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 03:19:05.089336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 306/600] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/services/network => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.096776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.106249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4a66-c71a-499f-9ebb-89c096e3ca90 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.119850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.120899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.121398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.121910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.123387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.123939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.125779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9f02f-f532-49bd-bdcb-7c052b9d0cf1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.135649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 295/601] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/services?name=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.142269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.154470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087f9bb-23f8-4b00-872a-7cab2e92d039 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.164676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.165694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.166212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.166717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.167633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] RBAC: Adding query filter params (type=network) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.168146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.170531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb43650-164c-4be9-90f5-cd277b4a950e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.181298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 307/602] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/services?type=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.266296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c025-a186-4efd-9603-bb6d781174f4 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.266905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c025-a186-4efd-9603-bb6d781174f4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.267395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c025-a186-4efd-9603-bb6d781174f4 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.269409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 296/603] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:05.285547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.286224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.286713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.313407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:05.314679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:05.327305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 308/604] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:05.376080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c025-a186-4efd-9603-bb6d781174f4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.394752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c025-a186-4efd-9603-bb6d781174f4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.404140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.404977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.405262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.405541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.422593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:05.428126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:05.429534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 297/605] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.436368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.445611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9c0dc-75b0-4137-a3fb-d5aac955c59f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.453358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.454023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.454309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.454593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.455345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.455652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.458018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.466781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 309/606] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.472994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.485296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04c48-abe2-4b13-ab11-5ff667f08cff admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.491087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.491872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.492164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.492602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.504479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.506378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.525620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:05.527047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 298/607] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.533463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.543742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda4527-bf6c-4fb1-93f4-0e6a48707482 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.549133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.549852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.550187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.550529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.551257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.551572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.553365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.566166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 310/608] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.572191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.582465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a20af-a65f-41c9-ad81-9c208d3158e6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.587021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.587806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.588095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.588405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.596820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.598837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.612756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:19:05.614237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 299/609] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.620412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.630435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061bdd8-02fd-4df0-b59c-b24aad04ae47 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.639766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.640464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.640755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.641034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.641877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.642190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.644024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.668169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 311/610] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.674960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.689327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737239b-a4d7-4715-9c07-5e50960ca227 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.697758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.698406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.698694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.698975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.711879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.713758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.725817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 300/611] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:05.731893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.741826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f4088-54b4-4688-9791-385fd2257e32 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.746576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.747906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.748191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.748498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.761408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.763323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.780971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:05.782390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 312/612] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.788506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.797693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31537144-00c7-4698-b111-323bac15b5a8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.802342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.802997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.803283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.803564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.804330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.804644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.806230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.819110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 301/613] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.825131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.835090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcb34b-24bc-47e1-9169-e9d5e682408d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.839696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.840513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.840800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.841764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.848852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.850779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.863908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:05.865388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 313/614] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:05.871690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.881975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3230-77a9-44c0-a1a4-5eea8608e190 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.886770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.887420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.887710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.888048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.888879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.889197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.891036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9b18d-752b-496f-bd8f-9885ac68c0cb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.902899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 302/615] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:05.909815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:05.920489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a52d5-d2ea-4eca-9ef1-0396da2b641b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:05.925125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:05.925770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:05.926059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:05.926341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:05.927167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=90dad318c8b1444795b9ea36a595d70e) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:05.927480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:05.929341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dda90-98bf-4449-81d0-9075187070dc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:05.936404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 314/616] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:05 2021] GET /identity/v3/role_assignments?user.id=90dad318c8b1444795b9ea36a595d70e&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:06.982608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978923a-f615-4a89-8b42-eb1d4404adf9 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:06.983903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978923a-f615-4a89-8b42-eb1d4404adf9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:06.984457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978923a-f615-4a89-8b42-eb1d4404adf9 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:06.986724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 303/617] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:06.992547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:06.993430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:06.993923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.018322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:07.019872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:07.030798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 315/618] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:07.061194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978923a-f615-4a89-8b42-eb1d4404adf9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.077672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978923a-f615-4a89-8b42-eb1d4404adf9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.088210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.089313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.089821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.090308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.107588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:07.114844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:07.116486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 304/619] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.122494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.131859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044d36b-f80d-4c3f-aec7-d412b50dca6d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.140986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.141783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.142183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.142574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.143460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.143884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.145615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.155018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 316/620] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:07.160734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.177141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a713eb3-fab5-44c4-be56-07801861416c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.184530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.185652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.185946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.186229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.196873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.198704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.223365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:07.224926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 305/621] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.230744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.240886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c72fa-2020-405b-8fdf-b30129fee6e9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.249043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.249701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.249990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.250272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.250998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.251311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.252947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.265696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 317/622] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:07.271602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.282028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9109e-2b00-467a-bde2-bb084b1ae3f5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.292064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.292895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.293184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.293466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.301530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.303561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.322827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:07.328335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 306/623] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.330468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.340542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e13b5-2d3c-40b3-85c4-6e6c5cdc00bc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.348622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.349313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.349602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.349885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.350735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.351048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.352925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad63e3-aaf7-4c37-b1a6-8a58e61ce88b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.381030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 318/624] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:07.387985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.398382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5852c-d1fd-4bdf-bede-41924e7ddc5e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.415094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.415946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.416254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.416540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.431087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.433323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.434463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567eec5-b7ea-453c-995f-67e75b0eac97 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.435298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567eec5-b7ea-453c-995f-67e75b0eac97 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.435583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567eec5-b7ea-453c-995f-67e75b0eac97 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.437800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 319/625] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:07.443367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78a8d-e6ea-4eb3-b1c6-55c05fcee2b4 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.443660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78a8d-e6ea-4eb3-b1c6-55c05fcee2b4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.444005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78a8d-e6ea-4eb3-b1c6-55c05fcee2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.452230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:07.453722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 307/626] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.461340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.478779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-30f78a8d-e6ea-4eb3-b1c6-55c05fcee2b4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:07.479062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaa8f-ab28-46c2-9ff7-476a2f381c32 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.480185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-30f78a8d-e6ea-4eb3-b1c6-55c05fcee2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:07.483423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.484136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.484448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.484704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.485485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.485787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.487516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.488811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 320/627] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:07.490111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ff79-5e13-4deb-8354-8f7396df1756 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.490396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ff79-5e13-4deb-8354-8f7396df1756 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.490675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096ff79-5e13-4deb-8354-8f7396df1756 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.492559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 321/628] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:07.506999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.507274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.507820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.517507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 308/629] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:07.522620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.529084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:07.530687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:07.534143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c741d84-8f51-45b2-9a56-9272dc08d843 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.539183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.544237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.544237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.544237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.544710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 322/630] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:07.545985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.556221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:07.561304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:07.562851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 309/631] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.564031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623136b-8103-4f3c-a00a-3c50b816d997 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.571700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.582505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.583603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.584140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.584667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.590102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187815-0d15-41e0-98d8-2197664001fd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.593085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.594919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.595590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.595878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.596158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.596544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.596959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.597293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.598915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.608088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 310/632] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:07.608905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.611767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-37c183e7-d516-42b3-8d5e-c289ec9dac6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:07.613192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 323/633] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.614787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee3d-e656-4be5-a33a-de6821c6f360 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.615275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee3d-e656-4be5-a33a-de6821c6f360 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.615766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceee3d-e656-4be5-a33a-de6821c6f360 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.617626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 324/634] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:07.618524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceee3d-e656-4be5-a33a-de6821c6f360 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.619660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971453-b517-47a1-b5c5-088f168bcf01 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.627314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.627969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.628293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.628580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.629295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.630300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:07.630300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:07.630300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:07.631180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.637452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceee3d-e656-4be5-a33a-de6821c6f360 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.641846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.642589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.642867 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.643142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.653092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.654928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.671292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:07.672416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 325/635] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:07.673200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.682349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f195de1-7890-4c29-893a-59d665c69dad admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.687218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.687826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.688562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.688562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.689158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.689465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.691263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9448-6942-40c1-a8e6-3bca30043adf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.702544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 326/636] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:07.703818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.704099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.704388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.721636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:07.722795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:07.730223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 327/637] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:07.730976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.740788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 311/638] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:07 2021] POST /identity/v3/services => generated 251 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:07.741970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.753793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678a7c2-5da1-4ae1-8876-489bb0cf6ea5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.776847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.777624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.778242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.778615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a6bb5-0eea-4ec1-9ae9-d078015a007e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.778740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.779385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:07.779732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.781687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.784149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.785361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.785904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.786357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.788744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=72464249c58f4f278dbea091c17c192a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.791631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.797622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 328/639] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:07.798626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.809540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223645b-985e-4513-8153-960565a6efd4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.815445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.816120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.816450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.816727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.818776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.820041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:07.820041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:07.820041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:07.821004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:07.878462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 312/640] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:07 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:07.879704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:07.915386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 329/641] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:07 2021] POST /identity/v3/services => generated 240 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:07.969569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f5981-8f5c-4afb-90f5-19a891474cd7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:07.985759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:07.986650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:07.987003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:07.987286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:07.996322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:07.999064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.015878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:08.017491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 313/642] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:08.024454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.043485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f19c7-fd6e-4fc8-85ab-4ec669966d94 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.050837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.051598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.051951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.052328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.053306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:08.053622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.055584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.078571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 330/643] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:08.087813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.099480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce1c4-64a6-4f5b-a12c-3a3678056766 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.109550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.110223 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.110812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.110812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.121298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.123646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.133769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 314/644] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:08.140704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.151427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520132-292f-483d-b8f8-996f2f41b563 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.158616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.159455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.159767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.160022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.172019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.173949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.191996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:08.198355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 331/645] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:08.199764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.208973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d45c-3ae6-4574-b15a-2effcc9ad90c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.213628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.214285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.214570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.214844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.215567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:08.216396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.218133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.230226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 315/646] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:08.236469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.246664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3edb4-b247-4ccc-ade1-a543770dadaf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.251845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.252711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.253043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.253313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.260826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.262855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.276220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:08.279144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 332/647] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:08.284562 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.294623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b918a74-aca5-4789-86b7-f46375b465aa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.299275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.299986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.300299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.300590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.301469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:08.301737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.303684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f82eca-d6e7-444f-850c-358969d99d7a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.320324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 316/648] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:08.323444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:08.334802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca03a8f-7e41-4a0a-bcde-dae91b5b89b2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:08.341468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:08.342174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.342459 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.342734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.343648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=0f880afb69144cd091940c8df415e8fd) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:08.343939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:08.345900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029588-4ef6-40fc-88eb-4f9a8ce5e09a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:08.351924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 333/649] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:08 2021] GET /identity/v3/role_assignments?user.id=0f880afb69144cd091940c8df415e8fd&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:08.912935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9a9-312a-438c-ab63-f12252ace483 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.913311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9a9-312a-438c-ab63-f12252ace483 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.913519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ab9a9-312a-438c-ab63-f12252ace483 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.915517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 317/650] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:08.921629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:08.921848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:08.922074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:08.949185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:08.950445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:08.958526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 334/651] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:09.007370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ab9a9-312a-438c-ab63-f12252ace483 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.025963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ab9a9-312a-438c-ab63-f12252ace483 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.030812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.031593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.031872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.032144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.042653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:09.049347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:09.050855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 318/652] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:09.057456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.066419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc2cf5-f699-455c-bbbb-d4e28ce5e8cf None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.076858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.077520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.077799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.078074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.078818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.079123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.080747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.092398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 335/653] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:09.098769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.113143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aa35a-bd1f-4a7e-a6d4-59227a98aa70 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.122792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.123587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.123873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.124152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.140529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.142369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.162164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:09.163492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 319/654] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:09.171296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.185213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355a8a7-c9a4-4f0b-9dbd-ef613b8e97fa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.193765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.194421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.194702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.194973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.195695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.195998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.197611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.214999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 336/655] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:09.221090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.233613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c125-25ba-4a0f-ab1b-6dd19d9adb76 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.238889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.239669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.239949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.240260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.252094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.254128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.275169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:19:09.276788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 320/656] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:09.283160 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.293079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ef28-99f8-4371-971d-1d4585125e85 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.300419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.301099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.301382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.301655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.302488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.302795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.304666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.329047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 337/657] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:09.335491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.346871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2ecd8-02d7-4b7f-ae28-460d7f875fc0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.357375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.358024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.358302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.358626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.366923 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.368685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.382408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 321/658] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:09.390027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.405611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c307a4-f9c7-49eb-9f20-5a101b5d7d7e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.413813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.414535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.414816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.415089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.430934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.430934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.455569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:09.457138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 338/659] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:09.463425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.482270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720dcb-ffa3-4787-9571-b828d8c4e60c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.489674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.490328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.490614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.490890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.491603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.491922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.493519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.517513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 322/660] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:09.523601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.537401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8763-8dee-4480-bbf9-13a0ca775d96 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.544470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.545274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.545562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.545841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.553787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.555816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.569801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:09.571047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 339/661] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:09.578112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.593736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277467-6495-4ffc-b53e-4640e23f942f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.604457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.605128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.605411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.605688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.606528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.606845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.608713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f607-11e4-41c4-a962-0f8bb1b8721b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.629470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 323/662] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:09.636218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:09.647137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef70c0-f20b-433d-aee6-ec61ce6c9a0f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:09.658139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:09.658836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:09.659163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:09.659445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:09.660335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=90dad318c8b1444795b9ea36a595d70e) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:09.660651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:09.662519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db81f7-2af4-49dd-b5c6-0794a5a8e359 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:09.676346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 340/663] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:09 2021] GET /identity/v3/role_assignments?user.id=90dad318c8b1444795b9ea36a595d70e&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.565571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2e71-97f7-4df9-b000-10b6e8f133a7 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.566123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2e71-97f7-4df9-b000-10b6e8f133a7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.566123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc2e71-97f7-4df9-b000-10b6e8f133a7 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.568162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 324/664] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:10.574585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8aba3-190f-46cb-813e-a20a5422ad06 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.575150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8aba3-190f-46cb-813e-a20a5422ad06 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.575150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8aba3-190f-46cb-813e-a20a5422ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.596661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-56e8aba3-190f-46cb-813e-a20a5422ad06 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:10.597880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-56e8aba3-190f-46cb-813e-a20a5422ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:10.611009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 341/665] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:10.635149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc2e71-97f7-4df9-b000-10b6e8f133a7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.646703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7519c-c9c2-4251-be2c-3771fe37b285 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.646993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7519c-c9c2-4251-be2c-3771fe37b285 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.647279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7519c-c9c2-4251-be2c-3771fe37b285 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.652325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc2e71-97f7-4df9-b000-10b6e8f133a7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.653227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 342/666] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:10.655111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.655400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.655680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.660844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.661638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.661926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.662204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.688473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:10.693510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:10.694729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:10.699539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:10.706465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 325/667] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:10.708382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.709699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 343/668] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:10.719002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70617091-477f-421a-8e14-99c74fb4080d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.728075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.728775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.729066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.729349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.730112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.730424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.732986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.740607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.745018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cd4f-e1ac-4c71-8f12-2f4b787db7f5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.754511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 326/669] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.761238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.762077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.762364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.762645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.763883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.765251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.765624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.775190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7cb54-66fd-409b-9c4d-40011ad65a53 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.778270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 03:19:10.784324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 344/670] 10.222.0.21 () {56 vars in 1151 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:10.786204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.797167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483863-d91b-48d5-9f36-d4982f0387dd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.797466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.798274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.798555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.798829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.802010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.802650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.802985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.803315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.804043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.804413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.806063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368eb9-5196-41d6-bc56-c3276730d8e7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.813769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 345/671] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.813769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf3312-869d-4431-9b8a-54cc7996ba5c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.816474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf3312-869d-4431-9b8a-54cc7996ba5c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.816474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf3312-869d-4431-9b8a-54cc7996ba5c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.816865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 346/672] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:10.818174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf3312-869d-4431-9b8a-54cc7996ba5c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.823351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.825008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.832672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf3312-869d-4431-9b8a-54cc7996ba5c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.837893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.838890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.839343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.839860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.840766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.841332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.842483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d0606d00-b0c6-4ab6-abef-44f9e0948370 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:10.843404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.843960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 327/673] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:10.845211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.845474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.845749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.850189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 347/674] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.851232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.861349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a81a-760c-41a4-a89d-141c026c0917 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.864834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:10.866134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:10.866671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.867623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.868110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.868735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.869614 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.870089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.871908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.875746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 328/675] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:10.876686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.884697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 348/676] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.891575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.893925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f163f6c-6390-4033-bb3a-075c6ee66070 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.907153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93a525-2d45-4218-aa0a-18e7a8e97b05 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.909344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.910024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.910306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.910581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.911391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] RBAC: Adding query filter params (interface=public, service_id=9b664517c5074da095448756f213bd0a, region_id=RegionOne) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.911704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.912769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:10.912769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:10.912769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:10.913669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.923425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.923765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 329/677] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/endpoints?service_id=9b664517c5074da095448756f213bd0a&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.924799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.925197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.925770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.926349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.938123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fc445-c756-4d50-8860-b8c53b52c4fb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.939132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.941329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.942992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.943777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.944060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.944373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.955259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:10.955791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:10.957403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 349/678] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:10.958284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.962105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:10.963401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 330/679] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:10.964017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.968832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5492d8-dcc9-473d-8e23-84b881fa2184 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.973504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.973974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5ec35-9051-45ff-9463-417ae4ee1be5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:10.974141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.974417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.974693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.975356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.976977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341875d1-1d61-4128-b941-0729838247a6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.978699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:10.979122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.979399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.979669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.980525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:10.980831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:10.982224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 350/680] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/services => generated 772 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:10.983349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b515-9d15-4c16-8409-50cfa650890e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:10.983454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aad02-e165-4321-93d6-accf14eb5de2 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:10.983454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aad02-e165-4321-93d6-accf14eb5de2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:10.984373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aad02-e165-4321-93d6-accf14eb5de2 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:10.986308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 351/681] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:10.986308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aad02-e165-4321-93d6-accf14eb5de2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:10.999889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aad02-e165-4321-93d6-accf14eb5de2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.006197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.007011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.007800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.008083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.008989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.009343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.009493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 331/682] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.010979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.011094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.011498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.011911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.020599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 352/683] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.021523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.032135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d487cb-37a7-4bbe-89a6-a1b1c841b735 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.033551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:11.035212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:11.037147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.037870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.038150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.038433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.052222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.052222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.052918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 332/684] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:11.054027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.060424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 353/685] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:11.066693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa9727-9828-49db-84db-367dcf13e7ff None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.067886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.079668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.080511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.080789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.081113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.088675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff4d-cff4-4f75-b0db-bef3fcd01f6d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.093919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.094486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.095450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.095874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.095983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.096477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.114738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:11.116032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 333/686] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.116694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.116882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.119057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.127774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62ce2-d56a-47db-85fb-6faa9af15d16 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.133164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.134018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.134296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.134563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.135273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.136945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.139851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:11.141651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 354/687] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.142666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.149067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 03:19:11.150577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 334/688] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.156660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.159529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae105ff-272e-40ec-a4d0-d95287579360 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.170207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.171268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.171707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd20ed7-9e13-4091-ba6b-0886150e7853 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.171956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.172601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.173735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.174335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.176567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.176690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.177384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.177719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.177997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.178799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.179103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.181048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.192775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 355/689] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.194108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.195012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 335/690] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.201766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.206401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11f4c2-faff-4222-8aea-35b0ced3ea20 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.212323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa7e3-33f4-4a50-ab2e-3f9c1910b326 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.213002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.213674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.213956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.214222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.214925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.215231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.217460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.218425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.219233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.219500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.219978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.223896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 356/691] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.224729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.229875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.232124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.234357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687a72d-29da-4609-baa1-323141f71fa4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.239942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.240772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.241051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.241338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.246042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:11.247726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 336/692] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.248640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.249932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.252164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.259111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fae0-496d-4aec-903a-294544a9ae9b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.264137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.264846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.265603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.265603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.266087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.266400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.267958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.268141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:11.274767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 357/693] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.274767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.279883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 337/694] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.280787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.284876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5de69-a560-4dd8-9dd4-e4c1cc16ce28 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.289391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.290029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.290310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.290580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.291056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abdfe8-4953-4a15-83a3-b7834e0f2b06 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.291351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.291664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.293653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.298462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.299225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.299508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.299784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.301026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.302118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.305499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.306506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 358/695] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.307387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.317724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00388b89-9b9f-4ae5-b029-189fc5973ee2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.322452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.323292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.323642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.323987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.325015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] RBAC: Adding query filter params (interface=public, service_id=3ab5a0fe24044b22b5a916e2fea88cb3, region_id=RegionOne) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.325881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.327174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:11.327174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:11.327174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:11.328267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.329887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 338/696] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.330874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.336029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 359/697] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/endpoints?service_id=3ab5a0fe24044b22b5a916e2fea88cb3&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.336856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.342048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32598-2dd7-41bf-94ae-31d69c17d48f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.346566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608fefa-9fdb-4550-bd54-0ddbad87dd0b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.347675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.348538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.348949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.349358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.350402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.350802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.351140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.351964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.352340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.352694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.352840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.360861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 339/698] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.361666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.373433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.375359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.386035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e873b9-cdfd-4bf5-bb34-a21faea790ca admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.400978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.401697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.401979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.402305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.402993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.404780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.407025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:11.408280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 360/699] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.415374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.424928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 340/700] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/services => generated 772 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.435535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580999-33c2-4e1e-aae6-63fa44b4c35b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.450120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.450863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.451147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.451632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.452575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.452885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.454496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.478188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 361/701] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:11.485074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.502395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f041bf0-5013-44b3-9873-2b877446dd44 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.513062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.513884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.514165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.514438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.528305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.530280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.545654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:11.552259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 341/702] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:11.553749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.564267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c717c-bff5-4eb2-9b71-dadeee49feeb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.569907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.570821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.571269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.571685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.573123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:11.573605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.576272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a7d22-7931-447e-9112-04008d51b986 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.590139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 362/703] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:11.597077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:11.609010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e5087-92a6-4a29-bd49-35214bbe9329 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:11.615391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:11.616553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:11.617003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:11.617415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/0f880afb69144cd091940c8df415e8fd/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:11.634767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=0f880afb69144cd091940c8df415e8fd, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:11.638207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526e7e-0c05-42d2-b52c-404473f1bc72 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:11.733148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 342/704] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:11 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/0f880afb69144cd091940c8df415e8fd/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:12.263534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f19d8-7e6f-4b6c-8890-d6692ee32aa5 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.264058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f19d8-7e6f-4b6c-8890-d6692ee32aa5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.264513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f19d8-7e6f-4b6c-8890-d6692ee32aa5 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.266413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 363/705] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:12.272569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.272865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.273154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.297200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:12.298405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:12.375884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 343/706] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:12.400233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f19d8-7e6f-4b6c-8890-d6692ee32aa5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.416539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f19d8-7e6f-4b6c-8890-d6692ee32aa5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.423392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.424177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.424538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.424823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.435686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:12.442852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:12.444377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 364/707] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:12.450955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.460402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328c5e8-5ed8-47f8-9f2c-770dbe0bb08c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.469292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.469968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.470255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.470537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.471355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:12.471672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.473322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.485236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 344/708] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:12.491494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.502742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91ec35-5c4a-44a6-98e5-e69e0a0d42e1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.507687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.508568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.508855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.509190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.523701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.525681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.544557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:12.545787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 365/709] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:12.552168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.562728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4be5d-e09a-4458-a5b0-cfacd6abc8b1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.567534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.568220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.568521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.568888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.569677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:12.569990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.571647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.585207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 345/710] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:12.592124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.602917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75df414-5a3d-4cb3-ba66-1169613121b9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.607887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.608775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.609063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.609344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.617624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.619779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.641012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:19:12.642194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 366/711] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:12.648561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.659229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4f0a0-cd38-4833-b3a0-a8559e392bdf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.668225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.669010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.669301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.669583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.670482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:12.670846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.672831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.702514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 346/712] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:12.708824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.725403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731aec0-d431-4fd4-bbe7-d3cc4ee0ba4e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.732967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.733874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.734161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.734439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.751496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.753431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.774487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:12.775926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 367/713] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:12.783226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.798761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e0656-5290-4917-8ac7-c4177835c49d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.813818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.814494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.814778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.815052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.815782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:12.816085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.817696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.835305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 347/714] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:12.842379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.857250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc59b5-7b3d-41ae-aaaa-98471efe1332 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.865627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.866599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.867104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.867526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.875193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.877497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.897593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:12.899129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 368/715] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:12.905753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.926550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c687-d37a-4a1a-af64-56434065b3fc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.937645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.938463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.938750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.939025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.939824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:12.940132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.942205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23285-c36d-488f-bb79-3f9d155d40b5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:12.960837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 348/716] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:12.967636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:12.978815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdffbdc-0be0-4b66-bd23-a1bffe75dc2a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:12.984113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:12.985057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:12.985324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:12.985600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/90dad318c8b1444795b9ea36a595d70e/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:12.988251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=90dad318c8b1444795b9ea36a595d70e, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:12.990907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e58fb-3b4e-4109-b79b-9ae1fd61df7c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:13.062072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 369/717] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:12 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/90dad318c8b1444795b9ea36a595d70e/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:13.937451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478469-3c41-45df-b9ef-77b19e79c8a0 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:13.937969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d375-252b-4464-830e-271f855ed0b0 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:13.938304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478469-3c41-45df-b9ef-77b19e79c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:13.938378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d375-252b-4464-830e-271f855ed0b0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:13.938479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c478469-3c41-45df-b9ef-77b19e79c8a0 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:13.938553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001d375-252b-4464-830e-271f855ed0b0 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:13.940240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 349/719] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:13.940358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 370/719] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:13.945764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718491e9-cfe8-4512-9067-0a4270b838db None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:13.946054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718491e9-cfe8-4512-9067-0a4270b838db None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:13.946335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718491e9-cfe8-4512-9067-0a4270b838db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:13.948857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396168-39d7-45dc-b66d-aae96de3c756 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:13.949142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396168-39d7-45dc-b66d-aae96de3c756 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:13.949430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae396168-39d7-45dc-b66d-aae96de3c756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:13.977743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-718491e9-cfe8-4512-9067-0a4270b838db None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:13.978930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-718491e9-cfe8-4512-9067-0a4270b838db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:13.986698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ae396168-39d7-45dc-b66d-aae96de3c756 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:13.987843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ae396168-39d7-45dc-b66d-aae96de3c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:14.066786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 371/720] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:14.084824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 350/721] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:14.086935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5ef7-218e-41df-b448-44ab86ec9b31 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.087226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5ef7-218e-41df-b448-44ab86ec9b31 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.087503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a5ef7-218e-41df-b448-44ab86ec9b31 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.092154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 372/722] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:14.096032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.096859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.097353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.097553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a5ef7-218e-41df-b448-44ab86ec9b31 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.117551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:14.118919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:14.122923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a5ef7-218e-41df-b448-44ab86ec9b31 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.127717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.128053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 351/723] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:14 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:14.136227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.136709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.137236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.137793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.138529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9162-73d4-4486-87f7-c90e2e651318 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.138917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.140897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.143047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.143823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.144105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.144409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] PATH_INFO: `/v3/services/network` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.145069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.146865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.160234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 03:19:14.162112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 03:19:14.163788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 373/725] 10.222.0.21 () {56 vars in 1151 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.163918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 352/725] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.170032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.173854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.183053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc5bfa-9eed-4f70-83ee-0013491e07fe admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.185055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d24dd-1d19-4da5-bd64-65f3cf43526e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.188462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.189159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.189533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.189817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.190527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.190835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.191440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.192434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.192902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.193391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.193887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.194742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.196629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.200280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 353/726] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:14.201342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.211581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5672b-f3be-4b85-918a-6a41347a1f9c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.214341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 03:19:14.220241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 374/727] 10.222.0.21 () {56 vars in 1154 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.220241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.222623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.223402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.223871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.224186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.225083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.225476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.227165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.227307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155c041-f7aa-40bf-8039-606beafbe1f4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.232086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 354/728] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.232944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.233772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.234115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.234450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.235217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.235586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.237640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.238046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.243372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 375/729] 10.222.0.21 () {56 vars in 1146 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.244958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.254390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457d108-be7e-4f56-a240-e3820163d305 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.259825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8d149-1348-4074-a4b4-438c368f2e42 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.260306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.261140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.261584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.261935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.262776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.263157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.265078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.265531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.266438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.266921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.267375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.268296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] RBAC: Adding query filter params (type=network) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.268796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.275447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.275601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 355/730] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.275601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.282734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4c1d2-6d6c-40e8-8ab9-0d2143a963d8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.283499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 376/731] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?type=network => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.288244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.288527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.288912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.289310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.289712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.290234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.291817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:14.291817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:14.291817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:14.292962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b887afb-fb25-45cf-81c1-657b7182b34d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.300940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb182-36ab-4595-a70b-62664781729c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.306147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.307031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.307486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.307901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.308844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.309344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.312062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.317291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 377/732] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.318041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.329353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38b7e-2709-40d9-b334-d35443a83d51 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.334483 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.335261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.335613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.335959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.336831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.337990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:14.337990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:14.337990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:14.339120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a877327-ca89-4201-811b-655545c27384 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.397910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 356/733] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:14 2021] POST /identity/v3/endpoints => generated 346 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:14.526087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 378/734] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:14 2021] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:14.527687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7484f1-f05a-41d8-884c-5ad0ca833dc4 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.528132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7484f1-f05a-41d8-884c-5ad0ca833dc4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.528599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7484f1-f05a-41d8-884c-5ad0ca833dc4 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.531316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 357/735] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:14.537690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.537977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.538260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.561602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:14.573731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:14.583008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 379/736] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:14 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:14.609102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7484f1-f05a-41d8-884c-5ad0ca833dc4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.622250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7484f1-f05a-41d8-884c-5ad0ca833dc4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.627075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.627879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.628232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.628572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.643801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:14.651151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:19:14.652725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 358/737] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.659489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.669978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108691-df3b-4be9-8317-1b38d3c50058 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.674803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.675549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.675833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.676105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.677030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.677342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.679056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.688686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 380/738] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.695190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.705642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3498cb-94e4-4956-93f6-c3614a5fe51d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.710614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.711460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.711738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.712067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.726025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.727971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.745836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:14.747875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 359/739] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.754166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.764900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381e7c2-2176-41de-9d4b-3cb9025836f4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.773141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.773869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.774149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.774423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.775204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.775509 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.777248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.791669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 381/740] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.797679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.808519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db3d7-7526-4fef-bf60-d3b56228eb6c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.814032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.815107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.815628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.816099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.825090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.827499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.842497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:14.844350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 360/741] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:14.853644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.866161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a64311-2570-4841-987c-3b0e86a483ae admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.871485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.872987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.873466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.873970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.874995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:14.875568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.877686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.900783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 382/742] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:14.907560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.917945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaba29b-e0ce-4696-982a-aa8e3e20dbeb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.925211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.926127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.926675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.927158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.936374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.938399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:14.948430 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 361/743] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:14.954984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:14.964985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b24a62-447c-4923-ac13-a8a843514dc1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:14.970390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:14.971469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:14.971957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:14.972474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:14.982918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:14.985104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.002214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:15.003894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 383/744] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:15.010444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.019748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8e5ae-ebb8-4263-b042-cc1adf78d556 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.024806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.025733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.026222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.026748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.027801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:15.028869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.030663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.044894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 362/745] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:15.050771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.060816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759284-9e03-4d71-9b4c-19096e38b9e5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.065579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.066470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.066886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.067277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.074223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.076852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.091788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:15.093429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 384/746] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:15.099691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.110225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00c8f9-84fb-4a38-9bbd-95e547f85386 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.115166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.115938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.116372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.116758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.117654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:15.118086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.120032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0e1a-30fc-4b84-bac3-f971065fcced admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.132124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 363/747] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:15.139609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.150892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4560e4-ffe8-420e-af73-fb9c414bb658 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.156004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.156940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.157336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.157722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.158692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=0f880afb69144cd091940c8df415e8fd) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:15.159011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.160993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266cee2-a200-433b-bc50-a1a91ae60176 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.167559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 385/748] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/role_assignments?user.id=0f880afb69144cd091940c8df415e8fd&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:15.752650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bc17-18cd-4f33-b9fb-32d50605f60b None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.753156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bc17-18cd-4f33-b9fb-32d50605f60b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.753339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5bc17-18cd-4f33-b9fb-32d50605f60b None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.755402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 364/749] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:15.761769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.762064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.762344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.780372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:15.781540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:15.789478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 386/750] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:15 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:15.814521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5bc17-18cd-4f33-b9fb-32d50605f60b None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.827565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5bc17-18cd-4f33-b9fb-32d50605f60b None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.834114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.834899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.835181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.835457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.845969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:15.852650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:15.854108 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 365/751] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:15.861234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.870351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea2f65-e23c-411a-8664-49a6c62f9701 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.875081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.875732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.876010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.876319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.877072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:15.877370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.878956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.888960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 387/752] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:15.895396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.906120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126bcb6-5abc-42c1-843c-65842d4765a4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.910733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.911508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.911791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.912060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.923311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.925180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.941553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:15.943016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 366/753] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:15.949169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.959404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b96d-70fe-4bb4-8fda-4d14931842ff admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:15.964048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:15.964728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:15.965009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:15.965285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:15.966054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:15.966355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:15.967930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:15.980461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 388/754] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:15.987195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:15.997070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5cdff-6080-4300-873f-d9e579325812 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.001775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.002551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.002937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.003155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.011604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.014519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.029548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 03:19:16.031375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 367/755] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:15 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:16.037557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.048286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219ed67-0532-4e65-84ac-d05e05de9dd9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.053180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.053846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.054134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.054413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.055250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:16.055727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.057622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.076606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 389/756] 10.222.0.21 () {56 vars in 1157 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:16.088606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.098901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47807fb-636d-4acf-b561-d1530210377c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.103755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.104682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.105177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.105669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.115642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.117779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.127514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 368/757] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:16.133791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.144550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564805e-533c-4f08-918f-a8569ad0e7c3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.149336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.150445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.150731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.151059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.162173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.164223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.181579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:16.182771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 390/758] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:16.189015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.198298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a435307-5d2d-4a67-af0e-6543d236b996 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.203163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.204065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.204598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.205084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.206006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:16.206522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.208322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.220993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 369/759] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:16.228248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.237963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d272ae-fda8-4e36-b289-45b53ff45fef admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.246090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.247270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.247757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.248263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.256257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.258821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.272357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:16.274148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 391/760] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:16.280812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.290749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d20e6e-576e-4e92-b9d3-1d5955674ee7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.295557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.296275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.296566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.296844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.297678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:16.297989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.299857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b57a-d1f8-49b5-b93f-5a5bb76df8ed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.314129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 370/761] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:16.320773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.331951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b774e8-b5fa-430e-8f41-18f8c725bf0e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.337227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.338181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.338727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.339242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.340331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=90dad318c8b1444795b9ea36a595d70e) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:16.341420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.343548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452593-423e-47ab-99b9-b6653e00a20c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.350280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 392/762] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/role_assignments?user.id=90dad318c8b1444795b9ea36a595d70e&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:16.596357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2fde3-2320-4177-a25b-80c270b71233 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.597052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2fde3-2320-4177-a25b-80c270b71233 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.597552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2fde3-2320-4177-a25b-80c270b71233 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.599879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 371/763] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:16.605716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fcf2e-7c8f-4746-ac54-d46a2dcd9613 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.606009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fcf2e-7c8f-4746-ac54-d46a2dcd9613 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.606819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fcf2e-7c8f-4746-ac54-d46a2dcd9613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.624627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fb1fcf2e-7c8f-4746-ac54-d46a2dcd9613 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:16.625825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fb1fcf2e-7c8f-4746-ac54-d46a2dcd9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:16.636310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 393/764] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:16 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:16.658309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2fde3-2320-4177-a25b-80c270b71233 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.671195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2fde3-2320-4177-a25b-80c270b71233 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.675696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.676385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.676670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.676960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.677780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.679414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e69f9-60d1-4454-bbab-d7b3e2669fc2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.779709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 372/765] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:16 2021] POST /identity/v3/services => generated 269 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:16.854556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85bf3-d785-45dc-a2e4-fe7212f900b2 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.854866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85bf3-d785-45dc-a2e4-fe7212f900b2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.855067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85bf3-d785-45dc-a2e4-fe7212f900b2 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.857745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 394/766] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:16.863556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.863845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.864121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.883414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:16.884686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:16.904266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 373/767] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:16.927659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85bf3-d785-45dc-a2e4-fe7212f900b2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.940725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85bf3-d785-45dc-a2e4-fe7212f900b2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.945184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.945990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.946275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.946548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.947197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.948829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.960243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 03:19:16.961728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 395/768] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:16.968637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:16.978177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39177a-7dc2-4000-9cd4-e354fb71456a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:16.983067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:16.983878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:16.984260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:16.984616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:16.985418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:16.985798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:16.987512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338fa04-f3bf-429f-b4b1-781197c62c27 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:16.993023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 374/769] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.000618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.011390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61db9e-cca7-4934-91ca-cdb7304976f2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.016251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.016909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.017188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.017463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.018171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.018475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.020050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d91f9f-1d5f-4d44-a45b-bc53d35b8196 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.025206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 396/770] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:16 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.426787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c01b7-a3c7-45f7-a33e-43eacc9d61af None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.427165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c01b7-a3c7-45f7-a33e-43eacc9d61af None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.427363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c01b7-a3c7-45f7-a33e-43eacc9d61af None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.429449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 375/771] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:17.435282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.435584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.435871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.454986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:17.456180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:17.464469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 397/772] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:17 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:17.489187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c01b7-a3c7-45f7-a33e-43eacc9d61af None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.502374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c01b7-a3c7-45f7-a33e-43eacc9d61af None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.506831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.507884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.508168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.508477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.519128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:17.526318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:17.527502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 376/773] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:17.534045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.551078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346695f-3599-4e6b-9733-18f2d4e72796 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.551078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.551078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.551078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.551672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.551672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.551672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.552042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.560904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 398/774] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.566998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.577840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8f4e-5c28-43ba-b860-86a80bf8a857 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.582389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.583157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.583442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.583717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.594337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.596292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.616683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:17.618234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 377/775] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:17.624595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.634862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eff492-a14e-471c-8187-31eefa63dbb6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.640296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.640963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.641250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.641581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.642309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.642678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.644369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.656982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 399/776] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.663100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.675545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a4d45-7a86-42cf-8fd7-2cc0a423fd9b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.680842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.681969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.682462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.682995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.691519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.694091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.709508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:17.711348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 378/777] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:17.718699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.729067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7e79-513e-4844-ad94-f6e2ea03f59c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.734182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.735176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.735713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.736187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.737306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.737887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.739984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.759227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 400/778] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.765986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.776188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac40fd-2bf3-42eb-a3d9-9ef60457ca03 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.781670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.782619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.783154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.783649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.792156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.794536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.804241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 379/779] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:17.811141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.821528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab25d0-2d50-4327-957d-9dda664c090b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.826665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.827757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.828288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.828826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.839726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.842371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.861419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:17.863251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 401/780] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:17.869941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.879771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc7dae-038f-4e7e-98ef-6ff50958377a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.885106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.886023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.886510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.887007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.888060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.888601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.890404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.903674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 380/781] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:17.910145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.920513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b6059-92fb-4030-b97a-f4bf2a57bd72 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.925511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.926584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.927110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.927595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.935877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.938191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.951607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:17.953423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 402/782] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:17.959939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:17.971043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400d71c-b120-4d6d-a16f-57b7b2615270 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:17.976518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:17.977481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:17.977968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:17.978488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:17.979543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:17.980055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:17.982290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16364bcb-9223-4211-b567-3dde4d7351e8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:17.995677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 381/783] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:18.003087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:18.014575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f204b-d7ce-493b-b0bd-01f9ce250454 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:18.019617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:18.020571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.021078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.021614 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.022643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] RBAC: Adding query filter params (role.id=233855360e944968a2acc2e66ec45a80, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=0f880afb69144cd091940c8df415e8fd) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:18.023187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:18.025317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672de87-e082-4c30-babd-089f4dee0d4c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:18.032178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 403/784] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:18 2021] GET /identity/v3/role_assignments?user.id=0f880afb69144cd091940c8df415e8fd&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=233855360e944968a2acc2e66ec45a80 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:18.656219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe63e-df0e-44ce-b782-90ab82d5c4a3 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.656219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe63e-df0e-44ce-b782-90ab82d5c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.656219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe63e-df0e-44ce-b782-90ab82d5c4a3 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.656882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 382/785] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:18.664623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.665174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.665669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.694658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:18.696057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:18.713641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 404/786] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:18 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:18.737023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe63e-df0e-44ce-b782-90ab82d5c4a3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:18.758733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe63e-df0e-44ce-b782-90ab82d5c4a3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:18.769316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:18.770415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.770891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.771371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.772229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:18.774026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:18.788023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 03:19:18.793579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 383/787] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:18.800235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:18.806579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e0082-ad3b-4801-9a89-25b8cb459361 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:18.811285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:18.811955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.812268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.812553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.813272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:18.813579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:18.815191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d8800-d570-468d-a0cd-e894f057a888 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:18.820389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 405/788] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:18.827278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:18.837470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683d40-c26f-4822-a7ca-d6ba2121b2c4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:18.842439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:18.843156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:18.843446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:18.843723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:18.844531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:18.844842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:18.846528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb5bad-029d-48a8-9270-3940583264e1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:18.851749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 384/789] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:18 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:19.178758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86ead-dc48-4140-9e1d-087e933dbd0b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.179737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86ead-dc48-4140-9e1d-087e933dbd0b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.180255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f86ead-dc48-4140-9e1d-087e933dbd0b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.182517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 406/790] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:19.188087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.188551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.188762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.206990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:19.208559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:19.217631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 385/791] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:19 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:19.241098 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86ead-dc48-4140-9e1d-087e933dbd0b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.257718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f86ead-dc48-4140-9e1d-087e933dbd0b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.262545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.263595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.264071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.264566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.265482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.267321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.279948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b68742f0-14c2-4e53-883e-2340ed1b6632 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 03:19:19.281938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 407/792] 10.222.0.21 () {56 vars in 1154 bytes} [Tue Aug 10 03:19:19 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:19.288827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.292657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb601c-4fe0-4960-8408-ed728356f1f0 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.292962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb601c-4fe0-4960-8408-ed728356f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.293244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb601c-4fe0-4960-8408-ed728356f1f0 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.295341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 408/793] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:19.299097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffc6e-839c-4bbb-9124-7d198a6528ac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.301128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.301419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.301700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.304725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.305728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.306263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.306776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.307674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:19.308177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.310561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.315898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 386/794] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:19 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:19.321420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:19.322460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.322631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:19.331021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 409/795] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:19 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:19.334215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bdacb-6154-4058-9670-0fe510272d55 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.338971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.339829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.340373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.341376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.342356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:19.342833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.344644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.350261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 387/796] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:19 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:19.355811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.356853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.365229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada9ebf-e789-46a7-8f42-7127368582ba None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.367209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55f150-8f8a-43b6-887e-fffbe5bd747a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.370619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.371395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.371758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.372686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.373482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.373736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.374549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.375014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.375471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dbdac1-871d-4cf8-b8d9-3c55652e9fbe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.375584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.376575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] RBAC: Adding query filter params (interface=public, service_id=51b4471ed9764919936d2a28f78bae22, region_id=RegionOne) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:19.377085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.378823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.386995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 388/797] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:19 2021] GET /identity/v3/endpoints?service_id=51b4471ed9764919936d2a28f78bae22&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:19.390550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:19.399555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c806-1b82-4db3-a846-713325f89efa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:19.403970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:19.404628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:19.404902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:19.405178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:19.405836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:19.407372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ab33c-3ee5-4383-8679-bf891145339a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:19.412708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 389/798] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:19 2021] GET /identity/v3/services => generated 1029 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:19:19.493729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 410/799] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:19 2021] POST /identity/v3/services => generated 251 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:20.264569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4102-7d88-4aa2-8928-5cdfbe285972 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.265620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4102-7d88-4aa2-8928-5cdfbe285972 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.266127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f4102-7d88-4aa2-8928-5cdfbe285972 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.268387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 390/800] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:20.274878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.275727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.276234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.294954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:20.296494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:20.313518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 411/801] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:20 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:20.338025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f4102-7d88-4aa2-8928-5cdfbe285972 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.350706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f4102-7d88-4aa2-8928-5cdfbe285972 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.355438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.357073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.357603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.358086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.369011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:20.376804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:20.378473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 391/802] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:20.385409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.395492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec08a3f-b3f9-4d23-a74f-0d5784b6dfd3 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.400518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.401432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.402054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.402534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.403551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:20.404074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.405909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.414934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 412/803] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:20.421831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.432364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ac-6691-493d-8edb-4c08cb1e49f8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.437201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.438236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.438724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.439202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.450389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.452501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.469876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:20.471890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 392/804] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:20.478434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.489255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e31b11-3632-4cf8-81d1-1ecd9818f6e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.494305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.495222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.495712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.496233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.497234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:20.497747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.499541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.513186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 413/805] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:20.519393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.529431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f7076-5ca9-482d-8209-95192dfed297 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.534513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.537790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.537790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.537790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.544792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.547002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.561750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:20.563458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 393/806] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:20.569910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.580912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa3460-6335-4ff1-9763-01df35d53ff1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.586111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.587111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.587624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.588086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.589213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:20.589724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.592091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.616014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 414/807] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:20.622144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.632027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7ac-f256-456a-ade2-28a94b61a33b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.637102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.638649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.639126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.639589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.650181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.652323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.670312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:20.676342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 394/808] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:20.679103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.689773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eea1e-8f62-4947-a608-cc574b6db3d0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.694984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.695918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.696454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.696922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.697891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:20.698437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.700412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.713016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 415/809] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:20.719975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.730256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c7824-6eac-4338-ae5f-0d8b93e83788 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.735301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.736460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.736955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.737439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.744846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.747708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.761309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:20.763072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 395/810] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:20.769553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.780503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bc5eb-8219-4e1c-ab51-734377599fe8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.785570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.786523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.787009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.787488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.788531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:20.789072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.791197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae3298-4647-445f-9e89-85d01bbb668e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.804138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 416/811] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:20.811449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:20.822131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d3ece-d3fa-4285-b7d7-69ec16d6f11d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:20.827100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:20.828256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:20.828731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:20.829258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/0f880afb69144cd091940c8df415e8fd/roles/233855360e944968a2acc2e66ec45a80` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:20.831690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=0f880afb69144cd091940c8df415e8fd, role_id=233855360e944968a2acc2e66ec45a80)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:20.834667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcaf91-445b-43ac-a954-1015e8e58fe9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:20.899824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 396/812] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:20 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/0f880afb69144cd091940c8df415e8fd/roles/233855360e944968a2acc2e66ec45a80 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:19:21.093970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21640c8-3a7b-4aba-b051-25fdedd0c0fe None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.094637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21640c8-3a7b-4aba-b051-25fdedd0c0fe None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.095152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21640c8-3a7b-4aba-b051-25fdedd0c0fe None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.097180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 417/813] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:21.103740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881ca5-1b3a-4d7e-ac26-1df5c0912839 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.104340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881ca5-1b3a-4d7e-ac26-1df5c0912839 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.104830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78881ca5-1b3a-4d7e-ac26-1df5c0912839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.123949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-78881ca5-1b3a-4d7e-ac26-1df5c0912839 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:21.125531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-78881ca5-1b3a-4d7e-ac26-1df5c0912839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:21.184895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 397/814] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:21 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:21.209205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21640c8-3a7b-4aba-b051-25fdedd0c0fe None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.222745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21640c8-3a7b-4aba-b051-25fdedd0c0fe None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.227695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.228710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.229189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.229718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.230627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.232626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ddb11-96ab-4175-be6a-393f6a4f058c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.323811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 418/815] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:21 2021] POST /identity/v3/services => generated 241 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:21.595095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6e53-1b7c-4e41-b7ae-153c28b8f226 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.595621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6e53-1b7c-4e41-b7ae-153c28b8f226 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.595621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f6e53-1b7c-4e41-b7ae-153c28b8f226 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.597798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 398/816] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:21.604344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b674-6e54-42e3-ad99-1f1ede11df1e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.604976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b674-6e54-42e3-ad99-1f1ede11df1e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.605470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9b674-6e54-42e3-ad99-1f1ede11df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.625776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7dd9b674-6e54-42e3-ad99-1f1ede11df1e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:21.627321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7dd9b674-6e54-42e3-ad99-1f1ede11df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:21.645072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 419/817] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:21 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:21.655489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb08bf-f125-44f2-95f2-8539c143909b None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.655786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb08bf-f125-44f2-95f2-8539c143909b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.656073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb08bf-f125-44f2-95f2-8539c143909b None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.658145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 399/818] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:21.663828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.664121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.664440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.669185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb08bf-f125-44f2-95f2-8539c143909b None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.681446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb08bf-f125-44f2-95f2-8539c143909b None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.686152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:21.686463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.687268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.687556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.687833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.688461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:21.688636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.690251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.698268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 420/819] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:21 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:21.708261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 03:19:21.708261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 400/820] 10.222.0.21 () {56 vars in 1154 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:21.710360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.720494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314490b-9fce-4114-a0c3-3e48cf7d36c7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.722932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.727706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.728517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.728803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.729081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.729933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:21.730244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.731983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.733922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fece618-eca3-43eb-ba69-ee84632ea595 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.742183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 421/821] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:21.742312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.743258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.744216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.744506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.744808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.745480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.747706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.756615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a271b-fc80-4c8a-9bff-dd5f601debd9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.759443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 03:19:21.763310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 401/822] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:21.766768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.767452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.767740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.768016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.768762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:21.769089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.769582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.770650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.776121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 422/823] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:21.780385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998dbc5-33bf-43dc-a181-70686e0abbf3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.782915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.785726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.786615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.787098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.787569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.788501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:21.789036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.790696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.792990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5ac71-22c8-4b9e-aaf0-f6c323f2ad2f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.800268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 402/824] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:21.802317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.803156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.803438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.803895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.804425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.805387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.807197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950aad2-81ad-4311-923c-7cc35b47dd38 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.813187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3181b32-1d75-4061-98ab-7e5c04d3a457 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.817984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.818703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.819060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.819411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.820181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:21.820606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.822222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.827907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 403/825] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:21.834017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.843496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897930e3-611a-4b5f-99d1-c2628a0d0125 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.847905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.848488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.848774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.849051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.849847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] RBAC: Adding query filter params (interface=public, service_id=7da6b547ca2040bf81ee8e9fa6e33303, region_id=RegionOne) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:21.850128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.851652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.857424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 404/826] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/endpoints?service_id=7da6b547ca2040bf81ee8e9fa6e33303&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:21.863073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:21.872615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedec2fe-af6c-4ced-9f44-ca3377c935e5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:21.876905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:21.877517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:21.877806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:21.878093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:21.878749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:21.881984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf392d3-7c6f-4932-a6ce-eed09a67056c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:21.892278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 405/827] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:21 2021] GET /identity/v3/services => generated 1497 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:19:21.906690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 423/828] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:21 2021] POST /identity/v3/endpoints => generated 347 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:23.116088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292396e-675f-41cf-bedf-a3faf8a1b261 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.116762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292396e-675f-41cf-bedf-a3faf8a1b261 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.116762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292396e-675f-41cf-bedf-a3faf8a1b261 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.118842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 406/829] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:23.125916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.126523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.126523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.144564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:23.145757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:23.168312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 424/830] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:23 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:23.189144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292396e-675f-41cf-bedf-a3faf8a1b261 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.201581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292396e-675f-41cf-bedf-a3faf8a1b261 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.206027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.206828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.207113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.207390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.218478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:23.225719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:23.232313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 407/831] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:23.233759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.242842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d26af1-289b-4998-a054-a5727c56a2bb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.248004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.248695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.248981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.249258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.249997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.250305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.251886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.264317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 425/832] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:23.266845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.277834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430c58d-20ad-4bfe-bdb5-c406bd4d6076 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.282945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.283722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.284003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.284310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.294884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.296738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.313105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:23.319446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 408/833] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:23.320832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.331343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25654f2-fe6d-4774-b521-a3604a9e02cf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.336153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.336881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.337171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.337449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.338168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.338476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.340128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.356694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 426/834] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:23.358975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.368835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b68-9fec-4bbd-9371-20cb10ecc694 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.373657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.374513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.374801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.375129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.383122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.385231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.400317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 03:19:23.406920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 409/835] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:23.408381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.419531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45793d8e-e4a0-4a61-b2f3-2762ee68e414 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.424684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.425440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.425723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.425999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.426928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.427245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.429253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a7ff4-3759-4271-b8b8-a32103c42393 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.452323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 427/836] 10.222.0.21 () {56 vars in 1171 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:23.456292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.466331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaff88-a0c9-4595-b268-5c7809c464e2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.471053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.471808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.472094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.472441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.480238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47ec-ce7d-44f6-a91c-760d052095a6 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.480589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47ec-ce7d-44f6-a91c-760d052095a6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.480870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47ec-ce7d-44f6-a91c-760d052095a6 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.480990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.483177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.483502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 428/837] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:23.490194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.490606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.490985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.492675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 410/838] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:23.498757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.507822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ac62-8831-4165-9198-af7a19078efd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.513099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.513896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.514174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.514456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.514623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:23.515812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:23.524126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 429/839] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:23 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:23.525431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.527274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.549450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.553616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:23.555097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 411/840] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:23.558775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94869d25-127c-43a6-9fd4-9fd74a4f3504 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.562073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.564715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.565775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.566269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.566735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.567578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.569387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.572028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90fa0b-410e-4c17-87d7-e4b988bd7bf7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.576932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.577618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.577905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.578183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.578963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.579271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.580929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.583006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 03:19:23.584677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 430/841] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:23.592277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.602011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5d47-7b07-48af-80cd-2b475062b008 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.603029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 412/842] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:23.605422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.607963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.608870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.609369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.609836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.610727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.611225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.613026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.616000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b01df-d189-400f-90a0-f4b0d531daed admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.624516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 431/843] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:23.625528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.627723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.628551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.628836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.629109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.636719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.639048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad647-10cf-40c6-9f52-906710ac4ed3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.639260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.644485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.645414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.645893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.646361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.647282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.647802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.649730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.653288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:23.659946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 413/845] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:23.661144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 432/845] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:23.661569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.662635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.673405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa4a0-80ca-40fd-bd03-0d39f6935079 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.678731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef747-130e-473b-a5ee-e0dc557b3f1e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.678960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.679575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.679864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.680140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.680964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=85337d5c9a874ff282e9f8e51c45be84, region_id=RegionOne) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.681273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.683157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.685494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.686781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.687484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.687952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.688934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.694260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 433/846] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/endpoints?service_id=85337d5c9a874ff282e9f8e51c45be84&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:23.694384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.694384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.697790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.709306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108f2a8-f8bf-468b-a2dd-7bd2d68292c7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.712530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 414/847] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:23.713841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:23.717578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.718499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.719014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.719693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.721228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.723270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a00ea6-05ba-47c2-b8ff-eb669531786c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.724361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab32c8-6492-4add-800d-0e25bf66db55 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:23.729251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:23.730009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:23.730294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:23.730569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:23.731521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] RBAC: Adding query filter params (role.id=233855360e944968a2acc2e66ec45a80, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=0f880afb69144cd091940c8df415e8fd) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:23.740225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:23.740225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474b0f-e5a3-45ee-810b-b90ae0da3fa7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:23.740503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 434/848] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/services => generated 1497 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:19:23.752408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 415/849] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:23 2021] GET /identity/v3/role_assignments?user.id=0f880afb69144cd091940c8df415e8fd&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=233855360e944968a2acc2e66ec45a80 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:24.113289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd9b1-7275-4172-8654-3b1fb1747b44 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.113591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd9b1-7275-4172-8654-3b1fb1747b44 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.113875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cbd9b1-7275-4172-8654-3b1fb1747b44 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.116044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 435/850] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:24.122113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442d8b-07ae-4aa8-b301-6429493884dd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.122623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442d8b-07ae-4aa8-b301-6429493884dd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.122904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442d8b-07ae-4aa8-b301-6429493884dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.141864 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-18442d8b-07ae-4aa8-b301-6429493884dd None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:24.143191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-18442d8b-07ae-4aa8-b301-6429493884dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:24.151491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 416/851] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:24 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:24.163606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12770-11d7-487d-a1d3-b4ec8d41d388 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.164063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12770-11d7-487d-a1d3-b4ec8d41d388 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.164373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d12770-11d7-487d-a1d3-b4ec8d41d388 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.166374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 436/852] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:24.172832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.173238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.173698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.174555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12770-11d7-487d-a1d3-b4ec8d41d388 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.186718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d12770-11d7-487d-a1d3-b4ec8d41d388 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.191188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.191962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.192105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:24.192278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.192559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.193202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.193784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:24.194773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.204603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 417/853] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:24 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:24.207315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 03:19:24.209455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 437/854] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:24.216088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.225435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae546-63b2-4c2a-a548-10c8c02c5f49 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.230135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.232337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.232449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.232746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.233113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.234022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:24.234348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.236020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.241395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 418/855] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:24.246623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618354-f494-4b4d-b2db-707de5d0cc9b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.247651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.257905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.258903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.259207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67674037-7d26-44ee-ab57-71ecc6e070a8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.259585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.260035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.260884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.263441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.264801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.265769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.266128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.266476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.267570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:24.267992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.269959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.274998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 419/856] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:24.280297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 03:19:24.280297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 438/857] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:24.286915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.298467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e083-56b0-4558-89dd-ddcca85ccc49 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.303809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.304686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.305137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.305514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.306406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:24.306817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.308630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.314968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 420/858] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:24.321397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.332489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb8277-23e1-43ff-919e-0179793dce89 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.337479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.338282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.338644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.338996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.339799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:24.340185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.341980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ddd2-1f1c-4108-96f9-2fffcc3f94fd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.348080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 439/859] 10.222.0.21 () {56 vars in 1136 bytes} [Tue Aug 10 03:19:24 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:24.354634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:24.365601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b332b6-0673-43e4-b2da-ce75c393f3c9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:24.370484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:24.371256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:24.371620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:24.372028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:24.372889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:24.374568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f90c7-88d3-4001-821c-fdfe72618e12 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:24.466216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 421/860] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:24 2021] POST /identity/v3/endpoints => generated 346 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:25.907926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff169e-f705-4eba-839a-86ddc1b1fda9 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:25.908671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff169e-f705-4eba-839a-86ddc1b1fda9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:25.908671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff169e-f705-4eba-839a-86ddc1b1fda9 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:25.912372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 440/861] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:25.918156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cd14-3b55-444b-b277-dd386842ed83 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:25.919193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cd14-3b55-444b-b277-dd386842ed83 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:25.919346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cd14-3b55-444b-b277-dd386842ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:25.938307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0c71cd14-3b55-444b-b277-dd386842ed83 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:25.939540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0c71cd14-3b55-444b-b277-dd386842ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:25.961296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 422/862] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:25 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:25.985427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff169e-f705-4eba-839a-86ddc1b1fda9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:25.995195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88237324-e946-40b5-9507-977dd7677c53 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:25.995862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88237324-e946-40b5-9507-977dd7677c53 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:25.996376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88237324-e946-40b5-9507-977dd7677c53 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:25.998793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff169e-f705-4eba-839a-86ddc1b1fda9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:25.999754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 423/863] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:26.005947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.006281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.006565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.008986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.010138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.010621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.011091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.011941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.015019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.024589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:26.025776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:26.028755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 03:19:26.030587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 441/864] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:25 2021] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:26.037241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 424/865] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:26.038282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.053939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449e1f4-37f4-481b-b51f-bf3ba04ad8c8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.058784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.060013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.060334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.060673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.061401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:26.061711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.063448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.068617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 442/866] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:26.069241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.079247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.079495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c771fc-cd0c-41a5-a430-8ada42174a34 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.084485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.085274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.085564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.085841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.086495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.088087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.094925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023fc34-5098-4d64-82ae-b13b2563f66c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.099527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 03:19:26.100048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.100942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.101426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.101923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.102955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:26.103489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.105305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.106750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 425/867] 10.222.0.21 () {56 vars in 1127 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:26.107969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.115789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 443/868] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:26.123249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496eeda-f4d6-47a7-b406-f6a0c0be3164 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.123387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.127710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.128419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.128709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.129206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.129693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:26.130009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.131594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.133154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc15bc-385b-41a2-9181-a05966000e84 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.138187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 426/869] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/services?name=image => generated 122 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:26.140837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.141497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.141778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.142051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.142789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.144392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414b5e9-d913-40f8-b4ac-b0ccacb83876 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.145125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.155236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab2fc2-74cd-4cc5-93b5-90de60dfe012 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.159784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.160462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.160710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.174569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.174569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] RBAC: Adding query filter params (type=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:26.174569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.174569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7eaad-7650-45ca-b8ac-1f4683297dcc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.174569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 427/870] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/services?type=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:26.238652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 444/871] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/endpoints => generated 349 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:26.522891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dda71-7312-46d6-a3ea-1e8263505b93 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.523078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dda71-7312-46d6-a3ea-1e8263505b93 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.523356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109dda71-7312-46d6-a3ea-1e8263505b93 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.525740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 428/872] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:26.531924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2675-0278-4809-a28a-196d8453ba01 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.534669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2675-0278-4809-a28a-196d8453ba01 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.534669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2675-0278-4809-a28a-196d8453ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.551383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e63e2675-0278-4809-a28a-196d8453ba01 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:26.552981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e63e2675-0278-4809-a28a-196d8453ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:26.571130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 445/873] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:26.597378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dda71-7312-46d6-a3ea-1e8263505b93 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.611583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109dda71-7312-46d6-a3ea-1e8263505b93 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.616275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.617009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.617295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.617574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.618321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.619895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d191ed-8d36-49e7-80b1-def97a998a25 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.701891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 429/874] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/services => generated 242 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:26.761918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a54d-5bfe-40a5-b15c-470430ade17b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.762647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a54d-5bfe-40a5-b15c-470430ade17b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.763151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08a54d-5bfe-40a5-b15c-470430ade17b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.765568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 446/875] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:26.772494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.773172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.773689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.793180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:26.794817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:26.813845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 430/876] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:26.838973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08a54d-5bfe-40a5-b15c-470430ade17b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.854546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08a54d-5bfe-40a5-b15c-470430ade17b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.859677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.860716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.861206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.861684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.862615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.864750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.866339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.common [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 03:19:26.916568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.sql.core [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 03:19:26.916568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 03:19:26.916568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [parameters: {'id': '11c39fed7b324efaacbcc7b430d45a4e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 03:19:26.916568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73155) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 03:19:26.933348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11c39fed7b324efaacbcc7b430d45a4e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 11c39fed7b324efaacbcc7b430d45a4e. Aug 10 03:19:26.936151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 447/877] 10.222.0.21 () {60 vars in 1162 bytes} [Tue Aug 10 03:19:26 2021] POST /identity/v3/projects => generated 262 bytes in 98 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:26.943024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:26.953095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2114c-bd24-403d-a70d-3f0fe01bdb10 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:26.958131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:26.959220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:26.959726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:26.960232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:26.968306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:26.970546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:26.985001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fe7ea28e-d79d-4e50-9b0d-17425faff15a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:26.986743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 431/878] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:26.993683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:27.006348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d7eac-51e7-4012-8975-e951ab394942 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:27.011769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:27.012794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:27.013288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:27.013779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:27.014816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:27.015323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:27.017657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decba086-9f96-4db9-a541-06d1cc1f3d91 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:27.039652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 448/879] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:26 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:28.337753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ea5-3820-4c4a-8b68-92c07322bb9f None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.338281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ea5-3820-4c4a-8b68-92c07322bb9f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.338382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94ea5-3820-4c4a-8b68-92c07322bb9f None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.341084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 432/880] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:28.348056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfd6-5f41-4460-99d4-162f622890db None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.348617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfd6-5f41-4460-99d4-162f622890db None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.348696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968dfd6-5f41-4460-99d4-162f622890db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.367608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d968dfd6-5f41-4460-99d4-162f622890db None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:28.369116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d968dfd6-5f41-4460-99d4-162f622890db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:28.384301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 449/881] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:28 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:28.389287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4a47-ec61-466c-a244-8dc16cde9429 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.389581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4a47-ec61-466c-a244-8dc16cde9429 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.389862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad4a47-ec61-466c-a244-8dc16cde9429 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.391853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 433/882] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:28.397705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.397998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.398276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.402689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4a47-ec61-466c-a244-8dc16cde9429 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.420272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad4a47-ec61-466c-a244-8dc16cde9429 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.423932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:28.424724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.425379 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.425664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.425947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.426344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:28.426676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.428299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.435570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 450/883] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:28 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:28.459643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.469216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8ff5d-2a49-4ef4-9f12-dbec15464cd8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.473875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.474664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.474948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.475296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.475877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.477500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.488952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 03:19:28.490285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 451/884] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:28.496348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.506190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57391-2c03-4768-8e2b-f3dbdfe0d5c8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.511024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.511654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.511937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.512287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.513523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:28.524507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.524643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 434/885] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:28 2021] POST /identity/v3/services => generated 242 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:28.524744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.532892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 452/886] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:28.539766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.562872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ac1d-e119-4e0c-a445-b652d7766243 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.568107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.569066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.569526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.569944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.570832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:28.571285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.573187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.579334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 435/887] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:28.586415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.597291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78818260-5487-43d6-9ccd-7c70c8c25bb7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.602497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.603397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] RBAC: Adding query filter params (interface=admin, service_id=85337d5c9a874ff282e9f8e51c45be84, region_id=RegionOne) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56874c9-68b0-4800-a53a-8e8219616989 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.618075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 453/888] 10.222.0.21 () {56 vars in 1271 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/endpoints?service_id=85337d5c9a874ff282e9f8e51c45be84&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:28.620763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.632440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acbd6d-3538-4928-b53d-8766f7428b64 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.637507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.638353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.638769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.639234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.640052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.641793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d257e6-bfc2-49e9-932a-d3eecacfd2e7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.649930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 436/889] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:19:28.875184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c09eb-4658-4e1f-8b8d-af7bdb8fedb2 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.875388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c09eb-4658-4e1f-8b8d-af7bdb8fedb2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.875672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c09eb-4658-4e1f-8b8d-af7bdb8fedb2 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.877756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 454/890] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:28.883921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.884220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.884515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.902791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:28.904024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:28.912102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 437/891] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:28 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:28.936541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c09eb-4658-4e1f-8b8d-af7bdb8fedb2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.949241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c09eb-4658-4e1f-8b8d-af7bdb8fedb2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.953994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.954891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.955296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.955684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.956481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.958158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:28.969817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 03:19:28.971527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 455/892] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:28.977605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:28.986566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a443297-c543-4419-b528-c19e6424ebd0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:28.991168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:28.991818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:28.992098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:28.992493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:28.993247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:28.993554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:28.995128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.001022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 438/893] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:28 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:29.007469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.019534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbd4f7-8e3f-4606-8d5a-83ee09349123 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.024420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.025195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.025585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.025963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.026772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:29.027197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.029430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.035047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 456/894] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:29.041280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.051097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63367b-6b48-40c1-801f-4b5f59fa94c9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.056021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.056851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.057336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.057752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.058719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] RBAC: Adding query filter params (interface=public, service_id=e3985852a733467d897382ba24f57421, region_id=RegionOne) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:29.059774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.061691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a43495-a579-4127-8a0b-ce5ce7756428 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.067301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 439/895] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:29 2021] GET /identity/v3/endpoints?service_id=e3985852a733467d897382ba24f57421&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:29.073466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.083552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3714-0418-41d6-8ab8-2d580a3a4307 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.088857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.089628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.090012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.090910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.091692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.093403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a109d9-7983-4258-9279-3c45c33b5a20 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.100336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 457/896] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:29 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:19:29.268770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ff49-7269-4d5f-8657-9ab79a245202 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.269105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ff49-7269-4d5f-8657-9ab79a245202 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.269330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9ff49-7269-4d5f-8657-9ab79a245202 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.271227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 440/897] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:29.277352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.277647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.278465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.296056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:29.297729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:29.306277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 458/898] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:29 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:29.332488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9ff49-7269-4d5f-8657-9ab79a245202 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.348350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9ff49-7269-4d5f-8657-9ab79a245202 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.353805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.354748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.355262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.355758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.357256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.359361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.360979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.common [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 03:19:29.407388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.sql.core [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 03:19:29.407388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 03:19:29.407388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [parameters: {'user_id': '03f5ba3468e14994b8ec62f56f63e92c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 03:19:29.407388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73156) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 03:19:29.413145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 03:19:29.414719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 441/899] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:19:29 2021] POST /identity/v3/users => generated 160 bytes in 83 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:29.421436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.430775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440aec3e-99ba-4a4d-a4b9-7b5ebcffcab9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.435626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.436450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.436740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.437019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.445361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.447419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.461637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-022e19a7-8634-4c1c-a2f3-2d38f7e6c67a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 03:19:29.463130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 459/900] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:29 2021] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:29.470373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:29.482137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65174-19ca-40ba-a528-e08493ab1331 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:29.486947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:29.487629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:29.487954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:29.488262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:29.489068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:29.489377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:29.491455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f77-6f32-4f38-83c0-f1b5a7e88eaa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:29.535702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 442/901] 10.222.0.21 () {56 vars in 1123 bytes} [Tue Aug 10 03:19:29 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:30.782591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471fb-f4ec-4d44-8bc3-04ef0c4234d5 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.783107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471fb-f4ec-4d44-8bc3-04ef0c4234d5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.783295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471fb-f4ec-4d44-8bc3-04ef0c4234d5 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.785253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 460/902] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:30.791214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.791608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.791783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.804761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe087-ec11-4b6a-8d15-e336c2f9be08 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.805052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe087-ec11-4b6a-8d15-e336c2f9be08 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.805335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe087-ec11-4b6a-8d15-e336c2f9be08 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.807206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 461/903] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:30.810159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:30.811757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:30.812935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.813229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.813517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.819755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 443/904] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:30 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:30.831336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:30.832552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:30.841742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 462/905] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:30 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:30.844914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.853792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899436b2-23d8-470f-be99-4e87704aa159 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.858358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.859355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.859462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.859696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.860389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.861982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.864141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.872995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 03:19:30.873127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20a29-f9ea-4a8a-98e9-4928544edbef None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.874319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 444/906] 10.222.0.21 () {56 vars in 1127 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:30.877725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.878518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.878798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.879072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.879717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.881380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.881483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.891670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5055a-43c8-45bb-b4df-99d74fce6bd7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.893240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 03:19:30.894404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 463/907] 10.222.0.21 () {56 vars in 1148 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:30.896675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.897330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.897621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.897898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.898640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:30.898918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.900515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.901018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.908344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 445/908] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:30.911173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445d950-f933-427a-9cb7-ee984c161a47 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.911821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.915903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.916579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.916864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.917141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.917872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:30.918150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.920281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.921689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69a56-08ce-4be2-abd7-bfda4e25f896 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.925406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 464/909] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:30.929249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.929898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.930184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.930552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.931262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:30.931578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.931980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.933173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.938229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 446/910] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:30.943781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168682-e220-4488-94fc-c8711ddcbb0c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.944468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.948503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.949157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.949445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.950244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.950949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:30.951257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.952860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.955162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a66a43-19a5-4da2-9b02-f639d36c54a3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.957710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 465/911] 10.222.0.21 () {56 vars in 1144 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:30.964009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.966072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.966724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.967035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.967318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.968111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] RBAC: Adding query filter params (interface=public, service_id=a898eaf9078e42ba85ee510c2e3581a4, region_id=RegionOne) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:30.968465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.970033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.973409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04295f34-2089-4306-af1b-4b553b46fa0f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.975302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 447/912] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/endpoints?service_id=a898eaf9078e42ba85ee510c2e3581a4&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:30.978487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:30.979119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:30.979407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:30.979688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:30.980534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:30.981686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:30.982628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2cb7a-9ba3-4012-b9d4-cdb407fb2c6b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:30.991083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d55ed2-7bc6-4e09-a1d2-870b1f542a54 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:30.995821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:31.002139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.002139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.002139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.002139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:31.002139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e3543-7157-4706-9d36-3e2c80830b3f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:31.013862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 448/913] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:19:30 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:19:31.066119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 466/914] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:30 2021] POST /identity/v3/endpoints => generated 325 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:31.232168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbdfa-f2ef-4acd-b3f9-3441b8e45d8a None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.232527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbdfa-f2ef-4acd-b3f9-3441b8e45d8a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.232783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbdfa-f2ef-4acd-b3f9-3441b8e45d8a None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.234600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 449/915] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:31.240806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.241099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.241376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.259873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:31.261067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:31.278994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 467/916] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:31 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:31.302998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dbdfa-f2ef-4acd-b3f9-3441b8e45d8a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:31.315681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dbdfa-f2ef-4acd-b3f9-3441b8e45d8a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:31.320253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:31.320974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.321263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.321535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.322187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:31.323768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:31.334641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 03:19:31.335925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 450/917] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:31 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:31.343158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:31.352142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb860-0f0b-4240-9303-12ea6a742336 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:31.357025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:31.357763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.358111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.358450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.359237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:31.359612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:31.361333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:31.366503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 468/918] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:31 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:31.373257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:31.383817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3587-1032-4c77-a5ef-5cfb6a58ceb3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:31.388727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:31.389526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.389936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.390321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.391130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:31.391541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:31.393250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4e0ee-4cb6-46c6-8dbe-9d14fdd23c8e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:31.398480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 451/919] 10.222.0.21 () {56 vars in 1134 bytes} [Tue Aug 10 03:19:31 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:31.405288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:31.415038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6af86-e118-4cec-924d-1fe6f5c2b4a5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:31.419682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:31.420353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:31.420691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:31.420968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:31.421793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:31.423428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285f7e7-3230-4231-9af9-c3f6823b8549 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:31.511364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 469/920] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:31 2021] POST /identity/v3/endpoints => generated 334 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:33.141114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32190b-0186-4928-9fc1-59eff735481a None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.141596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32190b-0186-4928-9fc1-59eff735481a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.141778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32190b-0186-4928-9fc1-59eff735481a None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.143609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 452/921] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:33.149676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47dc56-7ca4-42c5-8e43-3a158102481f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.150158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47dc56-7ca4-42c5-8e43-3a158102481f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.150230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47dc56-7ca4-42c5-8e43-3a158102481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.169682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ea47dc56-7ca4-42c5-8e43-3a158102481f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:33.170900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ea47dc56-7ca4-42c5-8e43-3a158102481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:33.190080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 470/922] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:33 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:33.214477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32190b-0186-4928-9fc1-59eff735481a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.221284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624565-4008-4f8b-9ce7-43019025f232 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.221577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624565-4008-4f8b-9ce7-43019025f232 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.221857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b624565-4008-4f8b-9ce7-43019025f232 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.223914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 471/923] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:33.228651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32190b-0186-4928-9fc1-59eff735481a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.230133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.230422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.230699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.233722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.234495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.234778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.235055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] PATH_INFO: `/v3/services/image` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.235709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.237321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.250303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 03:19:33.251015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:33.251711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 453/924] 10.222.0.21 () {56 vars in 1127 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:33.252929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:33.258326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.262448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 472/925] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:33 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:33.270262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bcfde-4cd7-400e-b1a5-2f712fa7808b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.275764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.276495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.276930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.277307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.278303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:33.278636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.280512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.290891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 454/926] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:33.291051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.291787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.295919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238e83-2e02-4f5f-8aca-e4dc7c318b30 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.300630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.301427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.301710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.302006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.303181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.304017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe77bff-52c5-41aa-8fb3-08bff248b943 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.304895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.306545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 473/927] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:33.309947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.310596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.310876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.311168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.311887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:33.312161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.313617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.314074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.319899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 455/928] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:33.324450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d123e1-e5a1-4535-bf82-78763f832109 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.326468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.329220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.329872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.330158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.330436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.331132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.333890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87651e5-f0c8-41ac-b1c7-4227e1e59229 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.337814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a5c24-5454-42c4-a53e-5ece06c09197 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.343860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.344541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.344826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.345098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.345824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.347388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0c1de-e972-41ff-ba81-fb3e26fcd836 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.441748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 474/929] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:33 2021] POST /identity/v3/projects => generated 311 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:33.482164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 456/930] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:19:33 2021] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:33.744436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf20a-01fd-48f1-8e9c-5e853c208a42 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.744728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf20a-01fd-48f1-8e9c-5e853c208a42 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.744932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccf20a-01fd-48f1-8e9c-5e853c208a42 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.747430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 475/931] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:33.753433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.754023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.754416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.772879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:33.774091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:33.839663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 457/932] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:33.864537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf20a-01fd-48f1-8e9c-5e853c208a42 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.876979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccf20a-01fd-48f1-8e9c-5e853c208a42 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.881384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.882435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.882718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.882989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.893869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:33.900999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:33.902319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 476/933] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:33.909531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.918906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222dc1d-2ec0-4b5e-8699-94b623cc2dac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.923528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.924305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.924665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.925109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.925972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:33.926333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.927993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.936475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 458/934] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:33.942506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:33.953375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4dbbb-dc8c-4ba4-8b32-b7969db203e5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:33.957980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:33.958743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:33.959029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:33.959303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:33.969742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:33.971561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:33.988230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:33.989504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 477/935] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:33.995994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.005591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc4304-152c-4111-977e-0b9c7ca7a41e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.010432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.011168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.011528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.011879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.013199 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:34.013701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.015344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.032063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 459/936] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:34.033478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.042948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6dccd-4b82-49b0-ab88-2ae451b15170 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.047941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.048746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.049034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.049308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.056464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.058468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.072334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:34.073628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 478/937] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:34.079822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.089712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee86f-2483-4dca-98f2-a3639b3770e7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.094690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.095360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.095660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.095937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.096868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:34.097177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.099063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.117900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 460/938] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:34.124791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.134743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaaeff1-18a7-4dad-af7b-51179e47d3fd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.139511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.140135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.140451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.140734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.148481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.150230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.164325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 479/939] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:34.165591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.175974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341637-1d32-46b1-9662-8a860605b77b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.180560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.181408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.181766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.182114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.193272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.195074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.211711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:34.216991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 461/940] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:34.220030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.229175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3111-ea5b-46af-884a-ffcbee43be79 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.234354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.235003 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.235276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.235547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.236295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:34.236602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.238187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.254642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 480/941] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:34.256219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.266123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca49962-f0b2-4729-8d38-889ff8e9a6da admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.270524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.271301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.271582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.271858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.279306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.281288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.294691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:34.296068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 462/942] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:34.302231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.311899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305efcc-3a50-477f-8f81-916d1dbc3b42 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.316637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.317281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.317564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.317837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.318605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:34.318911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.320751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30e5e-b5f7-4d1a-b68b-ec99a05d8418 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.333123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 481/943] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:34.339431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:34.350210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16826b-a121-4e89-bc4d-4b31970a7c28 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:34.354691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:34.355335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:34.355616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:34.355947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:34.356813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] RBAC: Adding query filter params (role.id=233855360e944968a2acc2e66ec45a80, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:34.357121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:34.358925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda398d4-e845-4324-8098-20701b1ebb0f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:34.364794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 463/944] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:34 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=233855360e944968a2acc2e66ec45a80 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:35.641916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf8a3-0576-480e-b95b-3344797c5a96 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.642448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf8a3-0576-480e-b95b-3344797c5a96 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.642448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebf8a3-0576-480e-b95b-3344797c5a96 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.644660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 482/945] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:35.651457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e8b7-0559-432a-9d93-c559b927b324 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.652004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e8b7-0559-432a-9d93-c559b927b324 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.652004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2e8b7-0559-432a-9d93-c559b927b324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.670894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9de2e8b7-0559-432a-9d93-c559b927b324 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:35.672139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9de2e8b7-0559-432a-9d93-c559b927b324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:35.680458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 464/946] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:35.707443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebf8a3-0576-480e-b95b-3344797c5a96 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:35.719208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47007-fd08-47d5-8498-e761575630ba None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.719696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47007-fd08-47d5-8498-e761575630ba None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.719992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca47007-fd08-47d5-8498-e761575630ba None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.720897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebf8a3-0576-480e-b95b-3344797c5a96 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:35.722180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 465/947] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:19:35.727548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.727823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:35.727941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.728111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.728717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.728999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.729271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.730430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:35.732707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:35.734450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 483/948] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:35.740597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:35.746576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:35.747786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:35.751554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545342de-6e4b-424b-8d50-52e4aac76c2b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:35.755535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 466/949] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:19:35.756639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:35.757551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.757833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.758107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.758794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:35.760755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aef3f-7115-4944-9650-1223880fe50a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:35.780332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:35.789357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d6276-2922-4218-bf95-4cd1bc2122c9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:35.794612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:35.795248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.795535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.795816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.803454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:35.805316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:35.819282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 467/950] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:35.820640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:35.828980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92bbf0-47d0-4bbb-9331-b55eda546998 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:35.833505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:35.834240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:35.834526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:35.834800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:35.835944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:35.837587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93407fd-e6e1-4ced-865e-09760834b683 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:35.839161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 468/951] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:35.892827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 484/952] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:19:35 2021] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:19:36.643452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6bd5e-86af-44a7-a6a5-4584407cb539 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.643742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6bd5e-86af-44a7-a6a5-4584407cb539 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.644025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6bd5e-86af-44a7-a6a5-4584407cb539 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.645846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 469/953] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:36.651927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.652404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.653145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.673685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:36.674865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:36.682637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 485/954] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:36.705782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6bd5e-86af-44a7-a6a5-4584407cb539 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.718703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6bd5e-86af-44a7-a6a5-4584407cb539 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.723060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.723851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.724133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.724440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.735114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:36.742290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:36.743474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 470/955] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:36.750080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.759530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cbb1c-5bb8-4a55-8d8c-50321b2b70a1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.764117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.764859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.765206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.765543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.766347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:36.766734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.768362 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:36.776542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 486/956] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:36.783398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.795603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516ddfb-4566-46a6-905a-a22a5120b60a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.800131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.800925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.801206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.801478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.811484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.813329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:36.830203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:36.831383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 471/957] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:36.837732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.847939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbfbea-a201-424d-bc7a-0182b19d9813 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.852534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.853189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.853471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.853747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.854465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:36.854773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.856399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:36.868743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 487/958] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:36.875033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.884773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f489-3313-48e2-9924-e51c9853f453 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.889769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.890546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.890827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.891101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.898419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.900365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:36.914022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:36.915297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 472/959] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:36.922415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.933750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5ecc-cf83-4ad6-9463-a3d011ee3131 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.938334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.938993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.939276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.939550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.940404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:36.940714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.942529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:36.959977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 488/960] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:36.966815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:36.976366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f345c-aa3c-42e0-8d63-6eadc759e7bd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:36.980856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:36.981635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:36.981921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:36.982199 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:36.992304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:36.994123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:37.010678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:37.012565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 473/961] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:37.018727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:37.029217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8560-ae04-437b-8d32-1e264f1b80f8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:37.033813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:37.034463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:37.034744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:37.035018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:37.035729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:37.036035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:37.037653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:37.049244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 489/962] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:37.055212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:37.064905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0a0a4-b8a1-4201-9e93-b5c5ecdd7767 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:37.069381 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:37.070163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:37.070447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:37.070724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:37.078079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:37.080000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:37.093531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:37.094696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 474/963] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:37.101185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:37.111017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda568-1608-432e-a0be-7194fc663011 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:37.115533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:37.116188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:37.116496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:37.116770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:37.117563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:37.117872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:37.119798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d926f23-e958-4a35-bf88-51d22375a2e7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:37.133168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 490/964] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:37.140390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:37.150889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3039a5-be01-4528-a127-0486972e3591 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:37.155402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:37.156294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:37.156580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:37.156854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/233855360e944968a2acc2e66ec45a80` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:37.159028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=72464249c58f4f278dbea091c17c192a, role_id=233855360e944968a2acc2e66ec45a80)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:37.161677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f38e31-738d-4280-a322-6a2e8e67a61d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:37.258101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 475/965] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:37 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/72464249c58f4f278dbea091c17c192a/roles/233855360e944968a2acc2e66ec45a80 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:38.099457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa5f0-7118-44a6-ae48-dc2c207d37c8 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.099977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa5f0-7118-44a6-ae48-dc2c207d37c8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.100170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaa5f0-7118-44a6-ae48-dc2c207d37c8 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.101857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 491/966] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:38.108533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.108969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.109104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.131446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:38.132939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:38.198300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 476/967] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:38.222937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaa5f0-7118-44a6-ae48-dc2c207d37c8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.235557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaa5f0-7118-44a6-ae48-dc2c207d37c8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.239924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.240727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.241011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.241288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.251460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:38.258528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:38.259698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 492/968] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:38.266459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.275360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983639fc-7bdb-48e4-93ae-ebf400243b5d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.280403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.281072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.281360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.281642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.282391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:38.282702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:38.284317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:38.292965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 477/969] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:38.299915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.310111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e2452-3f42-4e46-9ad9-aa7eedeaa4f2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.314685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.315528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.315817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.316095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] PATH_INFO: `/v3/users/34600bad60824d0d8c79fd80c2f9bfae` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.329604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] RBAC: Authorizing `identity:get_user(user_id=34600bad60824d0d8c79fd80c2f9bfae)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:38.331742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:38.333578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 493/970] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/users/34600bad60824d0d8c79fd80c2f9bfae => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:38.339904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.350114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2b7-dbd9-447f-8df2-bb9864d643e4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.354492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.355123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.355406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.356233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.363956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:38.365719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:38.374812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 478/971] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:38.381280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.391705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e816-d57b-485d-bfa8-70f584761c77 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.397552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.398422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.398702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.398975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.400219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:38.402375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4de04-d31a-43ab-869d-3bfabcd83473 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:38.404087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 494/972] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:38.410855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:38.420163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740eed5-5336-4de8-bd19-c8349175fc0c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:38.424729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:38.425366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:38.425647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:38.425920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:38.426731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=64cae0bfab52452b930e27b4937b2ea2, user.id=34600bad60824d0d8c79fd80c2f9bfae) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:38.427040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:38.428876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c753ad-9a06-4640-9c9a-e7cc4dc262f9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:38.434796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 479/973] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:38 2021] GET /identity/v3/role_assignments?user.id=34600bad60824d0d8c79fd80c2f9bfae&scope.project.id=64cae0bfab52452b930e27b4937b2ea2&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:39.353023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c8d43-e311-4a17-998a-3f394bff9dc9 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.353565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c8d43-e311-4a17-998a-3f394bff9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.353565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c8d43-e311-4a17-998a-3f394bff9dc9 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.355324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 495/974] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:39.361374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.361786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.361879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.379260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:39.380465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:39.388941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 480/975] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:39.413481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c8d43-e311-4a17-998a-3f394bff9dc9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.425645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c8d43-e311-4a17-998a-3f394bff9dc9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.430027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.430821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.431106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.431382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.442112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:39.449294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 03:19:39.451020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 496/976] 10.222.0.21 () {56 vars in 1142 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:39.457579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.466556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060c05e-1763-4958-a316-9278302f9e51 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.471175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.471909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.472294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.472659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.473471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.473846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.475488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.483617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 481/977] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:39.489579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.500442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2140-1e80-4bb6-95bf-8b7caa681790 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.504979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.505750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.506034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.506311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.516959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.518768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.534650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:39.535818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 497/978] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:39.542056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.552126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8587f5-d695-4980-87b3-dc08ef088373 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.556943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.557621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.557906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.558181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.559446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.559758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.561408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.576249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 482/979] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:39.580617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.590258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388b0d7-a562-4908-9c9a-95379edacda5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.594853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.595637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.595922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.596217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.603343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.605397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.618738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 03:19:39.619826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 498/980] 10.222.0.21 () {56 vars in 1115 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:39.626607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.636539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e3167-9b14-4b88-bbbb-7a69dc7746a7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.641568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.642226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.642513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.642793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.643624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.643935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.645791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.667888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 483/981] 10.222.0.21 () {56 vars in 1155 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:39.669130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.678865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca927-8275-4702-87da-7f01334edb36 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.683463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.684646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.684931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.685202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.692815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.694557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.703701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 499/982] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:39.709703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.719144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f063f00-3fac-4d81-9cc2-7984b0af940e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.723685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.724489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.724775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.725052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.735006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.736837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.758002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:19:39.759159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 484/983] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:39.765982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.774767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed7688-4822-4536-84ef-0d8bd08fdecd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.779383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.780094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.780472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.780814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.781611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.781989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.783815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.795301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 500/984] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:39.801052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.810926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c1c43-0c7d-4a46-97d9-1f626f0cd3ff admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.815398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.816161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.816480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.816761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.823533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.825479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.838098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:19:39.839358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 485/985] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:19:39.845566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.855102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab8b34-123b-4994-984f-6ac5cfcfb184 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.860330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.860985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.861270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.861549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.862328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.862648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.864512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50e457-fc0f-430f-97a7-dbb13e9e9701 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.876907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 501/986] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:39.883715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:39.893841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93451ea4-ae56-4b87-82ee-fa3bc95d7bde admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:39.898301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:39.898930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:39.899216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:39.899494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:39.900346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] RBAC: Adding query filter params (role.id=233855360e944968a2acc2e66ec45a80, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=72464249c58f4f278dbea091c17c192a) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:39.900664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:39.902553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa586bf-e8bc-4478-b1df-5c7aa443527e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:39.908113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 486/987] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:39 2021] GET /identity/v3/role_assignments?user.id=72464249c58f4f278dbea091c17c192a&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=233855360e944968a2acc2e66ec45a80 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:40.521087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955f889-f0a8-43c0-bbfa-ac63a1d8c7a6 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.521591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955f889-f0a8-43c0-bbfa-ac63a1d8c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.521669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955f889-f0a8-43c0-bbfa-ac63a1d8c7a6 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.523420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 502/988] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:40.529622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.530045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.530178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.549078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:40.550266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:40.558009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 487/989] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:40.582956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955f889-f0a8-43c0-bbfa-ac63a1d8c7a6 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:40.595407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955f889-f0a8-43c0-bbfa-ac63a1d8c7a6 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:40.600076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:40.600903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.601189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.601470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.612577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:40.619395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:40.620784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 503/990] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:40.627878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:40.637224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04632fa0-9022-4a48-a72b-b22367d4cea1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:40.641865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:40.642525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.642810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.643087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.643841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:40.644153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:40.645786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:40.654669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 488/991] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:40.661428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:40.672475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e5a7b-de4f-4a81-9853-233df9820f5c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:40.677070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:40.677924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.678195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.678471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] PATH_INFO: `/v3/users/34600bad60824d0d8c79fd80c2f9bfae` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.679681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=34600bad60824d0d8c79fd80c2f9bfae)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:40.681825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:40.683414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 504/992] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:40 2021] GET /identity/v3/users/34600bad60824d0d8c79fd80c2f9bfae => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:40.690692 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:40.700814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ea8f8-6bf8-4226-90fd-70becce6dbcc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:40.705553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:40.706405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.706693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.706977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.708151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:40.710282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f653-c2be-442e-9eea-5886ab41e7d0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:40.711967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 489/993] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:40 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:40.718659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:40.728597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1712-a70f-4894-858f-822301ac93f1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:40.733702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:40.734575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:40.734861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:40.735136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2/users/34600bad60824d0d8c79fd80c2f9bfae/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:40.737106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cae0bfab52452b930e27b4937b2ea2, user_id=34600bad60824d0d8c79fd80c2f9bfae, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:40.739716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3893ed-60ff-4d09-95e1-d662bb1e6102 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:40.823731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 505/994] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:40 2021] PUT /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2/users/34600bad60824d0d8c79fd80c2f9bfae/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:42.917858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b017-7574-4463-af9d-37a28231bba5 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:42.918920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b017-7574-4463-af9d-37a28231bba5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:42.919015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b017-7574-4463-af9d-37a28231bba5 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:42.920753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 490/995] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:42.926777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:42.927196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:42.927325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:42.945501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:42.946684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:43.000824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 506/996] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:43.025321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b017-7574-4463-af9d-37a28231bba5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.037344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b017-7574-4463-af9d-37a28231bba5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.041653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.042425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.042712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.043496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.053455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:43.060763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:43.061885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 491/997] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:43.068308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.077086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195083a-69b3-4abf-ac71-d25fcc6f9a00 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.081569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.082253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.082540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.082819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.083564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:43.083874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:43.085537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:43.093968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 507/998] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:43.100185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.111594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54e2e-a58d-45be-b74e-6ead36368caa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.119290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.120137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.120455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.120731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] PATH_INFO: `/v3/users/34600bad60824d0d8c79fd80c2f9bfae` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.122441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] RBAC: Authorizing `identity:get_user(user_id=34600bad60824d0d8c79fd80c2f9bfae)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:43.124560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:43.126144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 492/999] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/users/34600bad60824d0d8c79fd80c2f9bfae => generated 285 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:43.132618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.142673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c42e9-317b-4003-8f07-a25a94bba3e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.147177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.147806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.148091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.148402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.156544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:43.158285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:43.166920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 508/1000] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:43.173335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.182580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc4aeb-99e4-4558-989d-6e92a5eab81c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.187593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.188524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.188809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.189087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.190230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:43.192249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b06e3d-ef64-4c5a-9e70-4114e6f28f3d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:43.195030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 493/1001] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:43.202102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:43.210826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2dc21-6221-4db1-9d9e-772ea1d78516 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:43.215359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:43.215986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:43.216298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:43.216574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:43.217389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=64cae0bfab52452b930e27b4937b2ea2, user.id=34600bad60824d0d8c79fd80c2f9bfae) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:43.217699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:43.219561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf971a-2f32-48a9-8ea8-50a6a8c0c10d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:43.225220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 509/1002] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:43 2021] GET /identity/v3/role_assignments?user.id=34600bad60824d0d8c79fd80c2f9bfae&scope.project.id=64cae0bfab52452b930e27b4937b2ea2&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:45.336519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aed08-f623-4259-b5da-7aba2e96df6b None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:45.337040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aed08-f623-4259-b5da-7aba2e96df6b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:45.337133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aed08-f623-4259-b5da-7aba2e96df6b None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:45.338828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 494/1003] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:45.344895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:45.345332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:45.345460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:45.363253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:45.364399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:45.372458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 510/1004] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:45.397879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aed08-f623-4259-b5da-7aba2e96df6b None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:45.409719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aed08-f623-4259-b5da-7aba2e96df6b None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:45.413996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:45.414769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:45.415053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:45.415331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:45.416507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:45.418660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9c67e-1056-457a-bdfe-d771988d784e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:45.420220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 495/1005] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:45.426210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:45.435014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc02b50-4d93-4283-bf5b-b9a2a71f5051 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:45.439499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:45.440146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:45.440457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:45.440733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:45.441425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:45.443305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7eda-c928-41fc-afd7-a91b5df2b880 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:45.509505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 511/1006] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:19:45 2021] POST /identity/v3/users => generated 286 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:47.664983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58584317-8ece-4ee0-9439-882982404734 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.665576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58584317-8ece-4ee0-9439-882982404734 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.665576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58584317-8ece-4ee0-9439-882982404734 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.667285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 496/1007] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:47.673630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.674023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.674195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.692380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:47.693574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:47.701300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 512/1008] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:47.725833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58584317-8ece-4ee0-9439-882982404734 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:47.738182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58584317-8ece-4ee0-9439-882982404734 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:47.742492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:47.743323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.743607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.743884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] PATH_INFO: `/v3/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.745377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] RBAC: Authorizing `identity:get_role(role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:47.746374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:47.746374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:19:47.746374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:19:47.747236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:47.748568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 497/1009] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:47 2021] GET /identity/v3/roles/fccb1eae943b423e904443c48e4d0247 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:47.754547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:47.763590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d1e40-9d3b-461b-ab0b-cfead26d3f0e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:47.768075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:47.768949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.769233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.769507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] PATH_INFO: `/v3/users/d98de69f0a9f4f9e97245e70f70e8628` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.783013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] RBAC: Authorizing `identity:get_user(user_id=d98de69f0a9f4f9e97245e70f70e8628)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:47.785177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:47.786775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 513/1010] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:47 2021] GET /identity/v3/users/d98de69f0a9f4f9e97245e70f70e8628 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:47.793557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:47.802944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b4362-7a9a-4fda-ba1d-d052c32c1a13 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:47.807459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:47.808086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.808439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.809178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.816722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:47.818589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:47.828093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 498/1011] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:47 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:47.834678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:47.844039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15de08-0f11-415f-a131-49e35431e825 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:47.848563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:47.849391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.849670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.849945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.851087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:47.853137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62084e3-199e-4c91-88b0-b40ca4fe4f30 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:47.854753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 514/1012] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:47 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:47.860925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:47.869411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bbe13-2d77-4368-b676-cdfe894a0708 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:47.874490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:47.875119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:47.875404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:47.875680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:47.876537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=64cae0bfab52452b930e27b4937b2ea2, user.id=d98de69f0a9f4f9e97245e70f70e8628) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:47.876851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:47.878654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2df4-ac3e-4977-ad46-15410b435b2a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:47.884076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 499/1013] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:47 2021] GET /identity/v3/role_assignments?user.id=d98de69f0a9f4f9e97245e70f70e8628&scope.project.id=64cae0bfab52452b930e27b4937b2ea2&role.id=fccb1eae943b423e904443c48e4d0247 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:49.940275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78154b-4f19-4d7a-bdc9-c0469fd4c23b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:49.940829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78154b-4f19-4d7a-bdc9-c0469fd4c23b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:49.940829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78154b-4f19-4d7a-bdc9-c0469fd4c23b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:49.942561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 515/1014] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:49.948452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:49.948846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:49.949018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:49.966530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:49.967704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:49.975236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 500/1015] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:49.999321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78154b-4f19-4d7a-bdc9-c0469fd4c23b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:50.011466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78154b-4f19-4d7a-bdc9-c0469fd4c23b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:50.015836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:50.016691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:50.016977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:50.017254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] PATH_INFO: `/v3/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:50.018693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] RBAC: Authorizing `identity:get_role(role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:50.019687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:19:50.019687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:19:50.019687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:19:50.020596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:50.021895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 516/1016] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:49 2021] GET /identity/v3/roles/fccb1eae943b423e904443c48e4d0247 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:50.028271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:50.036798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143355-eeec-4aac-993a-cbc07c950caf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:50.041241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:50.042069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:50.042354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:50.042629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] PATH_INFO: `/v3/users/d98de69f0a9f4f9e97245e70f70e8628` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:50.043840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] RBAC: Authorizing `identity:get_user(user_id=d98de69f0a9f4f9e97245e70f70e8628)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:50.046447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:50.047972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 501/1017] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:50 2021] GET /identity/v3/users/d98de69f0a9f4f9e97245e70f70e8628 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:50.053772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:50.063082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234d83-0288-429c-822f-b4cc0ee2752d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:50.067578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:50.068407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:50.068696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:50.068974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:50.070117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:50.072086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a9b2-935a-4d34-8f91-fb063cf42fba admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:50.073709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 517/1018] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:50 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:50.079657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:50.088897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b6d9-bcaa-4930-bdc1-bfffe563576b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:50.093928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:50.094774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:50.095059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:50.095339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2/users/d98de69f0a9f4f9e97245e70f70e8628/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:50.097527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cae0bfab52452b930e27b4937b2ea2, user_id=d98de69f0a9f4f9e97245e70f70e8628, role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:50.100093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b4bc1-3809-4e77-9031-4c48be78fda7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:50.195103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 502/1019] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:19:50 2021] PUT /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2/users/d98de69f0a9f4f9e97245e70f70e8628/roles/fccb1eae943b423e904443c48e4d0247 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:19:52.262659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884eb3d-d407-4dfd-9df3-8173e5de550c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.263175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884eb3d-d407-4dfd-9df3-8173e5de550c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.263288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884eb3d-d407-4dfd-9df3-8173e5de550c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.265109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 518/1020] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:52.271032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.271408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.271596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.289272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:52.290437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:52.344995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 503/1021] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:52.368953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884eb3d-d407-4dfd-9df3-8173e5de550c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:52.381243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884eb3d-d407-4dfd-9df3-8173e5de550c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:52.385797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:52.387206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.387484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.387753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] PATH_INFO: `/v3/roles/fccb1eae943b423e904443c48e4d0247` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.389195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] RBAC: Authorizing `identity:get_role(role_id=fccb1eae943b423e904443c48e4d0247)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:52.390758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:52.392039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 519/1022] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:52 2021] GET /identity/v3/roles/fccb1eae943b423e904443c48e4d0247 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:52.398022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:52.406553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95527f-5f74-4a60-ac73-0442ab7d6c63 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:52.410980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:52.411821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.412104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.412412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] PATH_INFO: `/v3/users/d98de69f0a9f4f9e97245e70f70e8628` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.413587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] RBAC: Authorizing `identity:get_user(user_id=d98de69f0a9f4f9e97245e70f70e8628)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:52.415665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:52.417229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 504/1023] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:52 2021] GET /identity/v3/users/d98de69f0a9f4f9e97245e70f70e8628 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:52.422920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:52.432049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa8bc0-e96a-47ba-b3de-25330b75c59f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:52.437020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:52.437616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.437897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.438171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.445601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:52.447256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:52.456179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 520/1024] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:52.462074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:52.471103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c5400-41dc-4cf1-91d9-7c1b4516be51 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:52.475518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:52.476347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.476632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.476909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.478037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:52.480005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa56bd-bae6-443a-ad75-cda70df1ccb9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:52.481615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 505/1025] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:52 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:52.487646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:52.496493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe48f0d-380f-4cfd-a586-949ed918ede6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:52.501007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:52.501610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:52.501894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:52.502170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:52.502965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] RBAC: Adding query filter params (role.id=fccb1eae943b423e904443c48e4d0247, scope.project.id=64cae0bfab52452b930e27b4937b2ea2, user.id=d98de69f0a9f4f9e97245e70f70e8628) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:52.503274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:52.505074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bed8dd-032f-472b-b423-429be7b34154 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:52.510888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 521/1026] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:52 2021] GET /identity/v3/role_assignments?user.id=d98de69f0a9f4f9e97245e70f70e8628&scope.project.id=64cae0bfab52452b930e27b4937b2ea2&role.id=fccb1eae943b423e904443c48e4d0247 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:54.624529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a06d9-73c1-434b-b449-2d43996db5fb None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:54.625053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a06d9-73c1-434b-b449-2d43996db5fb None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:54.625168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a06d9-73c1-434b-b449-2d43996db5fb None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:54.626849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 506/1027] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:54.632995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:54.633432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:54.633553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:54.651186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:54.652423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:54.659950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 522/1028] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:54.684506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a06d9-73c1-434b-b449-2d43996db5fb None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:54.696448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a06d9-73c1-434b-b449-2d43996db5fb None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:54.701320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:54.702086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:54.702372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:54.702650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:54.703807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:54.705516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700aa130-7eb2-4e67-bba5-7551e764675f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:54.707060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 507/1029] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:54.712974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:54.721596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d376f90-7968-4444-bfed-d4c2423140b9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:54.726089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:54.726715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:54.727025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:54.727302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:54.728000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:54.729921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5ad07-859a-4e25-8286-8eaaf534df4a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:54.847472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 523/1030] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:19:54 2021] POST /identity/v3/projects => generated 311 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:56.966211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a07a7-c270-43a7-9885-53f89521d014 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:56.966775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a07a7-c270-43a7-9885-53f89521d014 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:56.966775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a07a7-c270-43a7-9885-53f89521d014 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:56.968562 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 508/1031] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:56.974470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:56.974875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:56.975027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:56.992163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:56.993367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:57.048166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 524/1032] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:57.073967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a07a7-c270-43a7-9885-53f89521d014 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:57.085844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a07a7-c270-43a7-9885-53f89521d014 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:57.090215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:57.090986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:57.091267 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:57.091540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:57.092732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:57.094433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0e3f2-d5be-4859-bde1-6652ff1dbdd4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:57.095987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 509/1033] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:19:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:57.102277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:57.111676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d0334-ee86-4e55-b6f9-3a598a6eeb5d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:57.116246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:57.116908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:57.117196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:57.117477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:57.118175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:57.120078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e236a-dfe3-47db-9f9b-9f585084c4c6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:57.227733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 525/1034] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:19:57 2021] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:19:59.334930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758389d-3b77-4884-ad23-e6831c76d843 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.335445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758389d-3b77-4884-ad23-e6831c76d843 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.335533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758389d-3b77-4884-ad23-e6831c76d843 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.337276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 510/1035] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:19:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:19:59.343831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.344259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.344451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.361773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:19:59.362896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:19:59.370560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 526/1036] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:19:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:19:59.395622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758389d-3b77-4884-ad23-e6831c76d843 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.407991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758389d-3b77-4884-ad23-e6831c76d843 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.412369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.413133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.413415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.413690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.423524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:19:59.430193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:19:59.431315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 511/1037] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:19:59.437633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.446398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e6015-39a1-4915-9e6c-7742441e48ac None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.451474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.452125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.452445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.452726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.453469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:59.453781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:59.455365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:59.463298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 527/1038] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:59.469861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.479555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1618-2b53-4d16-aaef-e7879b8a600b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.483959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.484817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.485105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.485382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] PATH_INFO: `/v3/users/f9d631f2582444938d69176a5ff8b61d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.497829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] RBAC: Authorizing `identity:get_user(user_id=f9d631f2582444938d69176a5ff8b61d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:59.499932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:59.501533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 512/1039] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/users/f9d631f2582444938d69176a5ff8b61d => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:19:59.507757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.517656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dce00-9c90-4231-84dd-ff83ecc4379a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.522163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.522785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.523070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.523346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.531437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:59.535859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:59.541829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 528/1040] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:19:59.547998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.557306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832408c-1f49-48ef-90c0-3342a8198f8e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.561731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.562557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.562837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.563118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] PATH_INFO: `/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.564291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f59dbb9080b4899bcbe1c705b7dee08)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:59.566274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958a17-605f-4f53-9988-4807b74cd580 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:59.567993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 513/1041] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:19:59.574643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:19:59.583225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5545f-0de7-4f19-9be2-e911a058e018 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:19:59.587774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:19:59.591099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:19:59.591099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:19:59.591099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:19:59.591099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08, user.id=f9d631f2582444938d69176a5ff8b61d) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:19:59.591099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:19:59.592439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52738-b046-4397-9447-64c9171b0e52 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:19:59.597605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 529/1042] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:19:59 2021] GET /identity/v3/role_assignments?user.id=f9d631f2582444938d69176a5ff8b61d&scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:20:01.963978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d2e8-b092-4d4a-b00c-6ad369ef2c92 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:01.965043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d2e8-b092-4d4a-b00c-6ad369ef2c92 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:01.965043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d2e8-b092-4d4a-b00c-6ad369ef2c92 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:01.966827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 514/1043] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:01.973059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da875-a038-47ec-8693-676328712dbf None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:01.973471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da875-a038-47ec-8693-676328712dbf None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:01.973619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da875-a038-47ec-8693-676328712dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:01.991503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-935da875-a038-47ec-8693-676328712dbf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:01.992759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-935da875-a038-47ec-8693-676328712dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:02.000568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 530/1044] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:02.024219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d2e8-b092-4d4a-b00c-6ad369ef2c92 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:02.036710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d2e8-b092-4d4a-b00c-6ad369ef2c92 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:02.041031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:02.041800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:02.042087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:02.042367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:02.052932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:20:02.060085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:20:02.061248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 515/1045] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:20:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:20:02.067757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935da875-a038-47ec-8693-676328712dbf None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:02.076669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935da875-a038-47ec-8693-676328712dbf None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:02.081169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:02.081845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:02.082210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:02.082410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:02.083150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:02.083457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:02.085082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:02.093864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 531/1046] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:20:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:02.100143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:02.111078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66f18-e8f4-44f8-91c4-03cd13f0f9d1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:02.115305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:02.116150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:02.116470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:02.116748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] PATH_INFO: `/v3/users/f9d631f2582444938d69176a5ff8b61d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:02.117964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9d631f2582444938d69176a5ff8b61d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:02.120065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:02.121669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 516/1047] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:20:02 2021] GET /identity/v3/users/f9d631f2582444938d69176a5ff8b61d => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:02.127764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:02.137433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c586d5-5181-4c03-9e2d-e0eeb421654d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:02.141937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:02.142777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:02.143064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:02.143342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] PATH_INFO: `/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:02.144536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f59dbb9080b4899bcbe1c705b7dee08)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:02.146559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd0119-2533-4e96-bd5b-cd91fca0ddb3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:02.148207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 532/1048] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:20:02 2021] GET /identity/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:02.154783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:02.164101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3085caf-2c53-441b-a65d-2dd568697496 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:02.169205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:02.170057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:02.170342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:02.170619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] PATH_INFO: `/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08/users/f9d631f2582444938d69176a5ff8b61d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:02.172571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f59dbb9080b4899bcbe1c705b7dee08, user_id=f9d631f2582444938d69176a5ff8b61d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:02.175152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb958-08d6-4824-857a-ee74238be715 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:02.298269 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 517/1049] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:20:02 2021] PUT /identity/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08/users/f9d631f2582444938d69176a5ff8b61d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:20:04.392671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcad80-0c7b-42a4-aab8-ed13e875cf79 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.393197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcad80-0c7b-42a4-aab8-ed13e875cf79 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.393298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcad80-0c7b-42a4-aab8-ed13e875cf79 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.394993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 533/1050] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:04.400831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.401208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.401394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.419157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:04.420385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:04.474919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 518/1051] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:04.499516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcad80-0c7b-42a4-aab8-ed13e875cf79 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.512708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcad80-0c7b-42a4-aab8-ed13e875cf79 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.517173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.517951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.518240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.518520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.528645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:20:04.535345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:20:04.536526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 534/1052] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:20:04.543591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.552392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844de7-e568-4205-9e47-90fb38cce813 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.556799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.557442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.557727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.558055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.559310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:04.559616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:04.561207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:04.569201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 519/1053] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:04.575657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.585767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdab9e-c0a0-4cf3-a92a-3a68829d57e4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.591855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.593195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.593480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.593754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] PATH_INFO: `/v3/users/f9d631f2582444938d69176a5ff8b61d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.594952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] RBAC: Authorizing `identity:get_user(user_id=f9d631f2582444938d69176a5ff8b61d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:04.597893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:04.599855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 535/1054] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/users/f9d631f2582444938d69176a5ff8b61d => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:04.606463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.615834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5d534-4bb0-456a-9cd8-542756c6b7b8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.620328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.621532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.621815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.622087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.629661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:04.631638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:04.640221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 520/1055] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:20:04.646340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.655738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cff38a-492b-4fe9-ae44-963beebe6402 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.660312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.661137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.661423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.661702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] PATH_INFO: `/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.662857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f59dbb9080b4899bcbe1c705b7dee08)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:04.664912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b084a-0fe0-4285-aee5-4831bd298a94 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:04.666533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 536/1056] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:04.673465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:04.681994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679513c-6b40-41ab-a2ad-1ae19acaebc4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:04.687023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:04.687644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:04.687939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:04.688248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:04.689067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08, user.id=f9d631f2582444938d69176a5ff8b61d) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:04.689382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:04.691161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b521b4-68d9-4c19-9ba9-bcec576777d4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:04.696825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 521/1057] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:20:04 2021] GET /identity/v3/role_assignments?user.id=f9d631f2582444938d69176a5ff8b61d&scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:06.822547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b481-ed9e-4eca-87cc-6c54b8d3ffe0 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:06.823075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b481-ed9e-4eca-87cc-6c54b8d3ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:06.823075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0b481-ed9e-4eca-87cc-6c54b8d3ffe0 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:06.825400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 537/1058] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:06.831328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:06.831727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:06.831881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:06.849680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:06.850839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:06.858375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 522/1059] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:06.881513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0b481-ed9e-4eca-87cc-6c54b8d3ffe0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:06.894015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0b481-ed9e-4eca-87cc-6c54b8d3ffe0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:06.898399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:06.899023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:06.899315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:06.899589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:06.907684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:06.909449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:06.918582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 538/1060] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:20:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:20:06.924828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:06.934200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4be19-44a0-4663-ac5d-747f87a5dd5e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:06.938699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:06.939477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:06.939762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:06.940037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:06.946799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:06.948646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:06.962587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-243f4a1d-5252-4fbc-acb3-7f5258affc30 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 03:20:06.963696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 523/1061] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:20:06 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:20:06.969967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:06.978561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbfcf-23ca-4fb7-b6f6-253ec5b2d039 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:06.983645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:06.984317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:06.984603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:06.984878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:06.985585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:06.985894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:06.987447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79850ccb-eff6-4f60-8842-450523a996a8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:06.994494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 539/1062] 10.222.0.21 () {56 vars in 1137 bytes} [Tue Aug 10 03:20:06 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:09.072949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff439d-cf09-4fad-9707-d7d1cc8e74de None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:09.073976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff439d-cf09-4fad-9707-d7d1cc8e74de None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:09.074068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff439d-cf09-4fad-9707-d7d1cc8e74de None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:09.075755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 524/1063] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:09.081620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb390-b3f1-4cc9-9658-346a0507744f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:09.082006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb390-b3f1-4cc9-9658-346a0507744f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:09.082190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb390-b3f1-4cc9-9658-346a0507744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:09.100187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-477cb390-b3f1-4cc9-9658-346a0507744f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:09.101528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-477cb390-b3f1-4cc9-9658-346a0507744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:09.109344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 540/1064] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:09.133770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff439d-cf09-4fad-9707-d7d1cc8e74de None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:09.146210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff439d-cf09-4fad-9707-d7d1cc8e74de None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:09.150511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:09.151151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:09.151435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:09.152270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:09.153015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:09.154016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:20:09.154016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:20:09.154016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:20:09.154889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0a928-f2c6-4166-af0b-7dd76292cb59 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:09.235567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 525/1065] 10.222.0.21 () {60 vars in 1160 bytes} [Tue Aug 10 03:20:09 2021] POST /identity/v3/domains => generated 267 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:20:11.348814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b05ed-79ed-4f3f-95d5-6b9f91624ee5 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:11.349334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b05ed-79ed-4f3f-95d5-6b9f91624ee5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:11.349449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b05ed-79ed-4f3f-95d5-6b9f91624ee5 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:11.351142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 541/1066] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:11.357435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:11.357834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:11.357986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:11.375859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:11.377000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:11.430983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 526/1067] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:11.455142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b05ed-79ed-4f3f-95d5-6b9f91624ee5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:11.467615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b05ed-79ed-4f3f-95d5-6b9f91624ee5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:11.471996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:11.472876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:11.473164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:11.473441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] PATH_INFO: `/v3/domains/dafda53b40f44d728358bfd9931fcd95` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:11.483597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dafda53b40f44d728358bfd9931fcd95)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:11.485606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dc36c-5dd4-4a9b-af69-edd55f855d59 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:11.487174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 542/1068] 10.222.0.21 () {56 vars in 1205 bytes} [Tue Aug 10 03:20:11 2021] GET /identity/v3/domains/dafda53b40f44d728358bfd9931fcd95 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:11.493321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:11.501950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497f5ff-548e-43e6-8008-b38b8a52e16c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:11.506605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:11.507238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:11.507519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:11.507793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:11.508549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:11.510413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1008a34-ae77-473c-be20-5111486c7c11 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:11.629979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 527/1069] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:20:11 2021] POST /identity/v3/projects => generated 361 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:20:13.758533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba44-4465-432d-aa50-249223a2a82a None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:13.759059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba44-4465-432d-aa50-249223a2a82a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:13.759059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba44-4465-432d-aa50-249223a2a82a None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:13.761399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 543/1070] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:13.767278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:13.767682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:13.767851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:13.786439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:13.787625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:13.843071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 528/1071] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:13.868829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ba44-4465-432d-aa50-249223a2a82a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:13.881756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ba44-4465-432d-aa50-249223a2a82a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:13.886109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:13.886943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:13.887221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:13.887491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] PATH_INFO: `/v3/domains/dafda53b40f44d728358bfd9931fcd95` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:13.888673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dafda53b40f44d728358bfd9931fcd95)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:13.890582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29850b9b-d0bb-4340-b6a6-0033581164b7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:13.892148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 544/1072] 10.222.0.21 () {56 vars in 1205 bytes} [Tue Aug 10 03:20:13 2021] GET /identity/v3/domains/dafda53b40f44d728358bfd9931fcd95 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:13.898252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:13.907123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18dc65-816d-4d97-a821-a771e51cfcac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:13.911589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:13.912262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:13.912550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:13.912825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:13.913520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:13.915422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7753-6760-4628-8fe9-6b3214933a77 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:14.040069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 529/1073] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:20:13 2021] POST /identity/v3/users => generated 311 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:20:16.188084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab70a9-3f03-438a-9618-fb92dbfcf22b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.188633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab70a9-3f03-438a-9618-fb92dbfcf22b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.188759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab70a9-3f03-438a-9618-fb92dbfcf22b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.190511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 545/1074] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:16.196457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.196866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.197020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.215266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:16.216503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:16.224107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 530/1075] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:16.248669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab70a9-3f03-438a-9618-fb92dbfcf22b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.262841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab70a9-3f03-438a-9618-fb92dbfcf22b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.267466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.268266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.268551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.268821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.281096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:20:16.288100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:20:16.289262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 546/1076] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:20:16.296229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.304888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1992f6-d309-4ddd-a97e-938f1a7f80d0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.309337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.309981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.310265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.310541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.311278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:16.311586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:16.313186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:16.321202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 531/1077] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:16.327188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.336654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d7d6-2344-4dbf-bc66-10480aace025 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.341615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.342435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.342716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.342987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] PATH_INFO: `/v3/users/1e3eb97736ce404bbf54db1ecbfd272f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.356666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e3eb97736ce404bbf54db1ecbfd272f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:16.358758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:16.360427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 547/1078] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/users/1e3eb97736ce404bbf54db1ecbfd272f => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:16.366173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.375437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862823-7a4f-451c-b64d-220fb073e165 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.379943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.380604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.380899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.381437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.389052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:16.390788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:16.399469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 532/1079] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:20:16.405992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.415023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f2d0e-c82d-4d6f-ba0b-a3f06aac19c7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.419967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.420796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.421078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.421348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] PATH_INFO: `/v3/projects/647963c20a404d129c9e30cc363e25e1` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.422486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] RBAC: Authorizing `identity:get_project(project_id=647963c20a404d129c9e30cc363e25e1)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:16.424490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417844f4-6ec4-49d2-be57-bb5b75c6e121 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:16.426116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 548/1080] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/projects/647963c20a404d129c9e30cc363e25e1 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:20:16.432230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:16.440547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614de88-d3bd-4e0f-8c38-686da7cc4385 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:16.445074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:16.445679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:16.445966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:16.446249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:16.447057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=647963c20a404d129c9e30cc363e25e1, user.id=1e3eb97736ce404bbf54db1ecbfd272f) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:16.447371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:16.449215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a306e80-ba05-4923-af2c-2a8f8e5dc09c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:16.454481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 533/1081] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:20:16 2021] GET /identity/v3/role_assignments?user.id=1e3eb97736ce404bbf54db1ecbfd272f&scope.project.id=647963c20a404d129c9e30cc363e25e1&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:18.521270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c4e60-96a1-40d7-aa61-c33e528d6d4e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.521851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c4e60-96a1-40d7-aa61-c33e528d6d4e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.521851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c4e60-96a1-40d7-aa61-c33e528d6d4e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.523598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 549/1082] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:18.530044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.530433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.530606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.548372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:18.549554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:18.557129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 534/1083] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:18.580168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c4e60-96a1-40d7-aa61-c33e528d6d4e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:18.592656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c4e60-96a1-40d7-aa61-c33e528d6d4e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:18.597008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:18.597769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.598056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.598334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.608747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:20:18.615422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:20:18.616566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 550/1084] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:20:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:20:18.622681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:18.631524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663802b-1541-49f4-8c19-141ad56c61bf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:18.635924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:18.636599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.636883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.637156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.637886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:18.638197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:18.639760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:18.647681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 535/1085] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:20:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:18.654053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:18.663894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9081630-3025-47a6-b512-bfa10298696e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:18.668983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:18.669821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.670105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.670377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] PATH_INFO: `/v3/users/1e3eb97736ce404bbf54db1ecbfd272f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.671553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e3eb97736ce404bbf54db1ecbfd272f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:18.673675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:18.675225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 551/1086] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:20:18 2021] GET /identity/v3/users/1e3eb97736ce404bbf54db1ecbfd272f => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:18.681031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:18.690152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5004d-1f77-4ffa-a586-95b66afcf152 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:18.694579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:18.695380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.695659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.695931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] PATH_INFO: `/v3/projects/647963c20a404d129c9e30cc363e25e1` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.697116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] RBAC: Authorizing `identity:get_project(project_id=647963c20a404d129c9e30cc363e25e1)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:18.699093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdbb6d-3ebf-47cf-84f8-55afa9ba0a4b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:18.700710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 536/1087] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:20:18 2021] GET /identity/v3/projects/647963c20a404d129c9e30cc363e25e1 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:18.706549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:18.716083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e86f96-c990-40c3-bf34-252ebd12fcf1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:18.720588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:18.721412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:18.721693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:18.721971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] PATH_INFO: `/v3/projects/647963c20a404d129c9e30cc363e25e1/users/1e3eb97736ce404bbf54db1ecbfd272f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:18.723853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647963c20a404d129c9e30cc363e25e1, user_id=1e3eb97736ce404bbf54db1ecbfd272f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:18.726417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125c6df-38e2-4ea5-bf5d-ca04a0ee5353 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:18.798992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 552/1088] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:20:18 2021] PUT /identity/v3/projects/647963c20a404d129c9e30cc363e25e1/users/1e3eb97736ce404bbf54db1ecbfd272f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:20:20.864361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5da9-c1fb-4036-8eb3-207ea22312ac None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:20.864955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5da9-c1fb-4036-8eb3-207ea22312ac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:20.864955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5da9-c1fb-4036-8eb3-207ea22312ac None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:20.866727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 537/1089] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:20:20.873045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:20.873480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:20.873584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:20.892454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:20:20.893634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:20:20.947339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 553/1090] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:20:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:20:20.971928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5da9-c1fb-4036-8eb3-207ea22312ac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:20.984007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5da9-c1fb-4036-8eb3-207ea22312ac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:20.988344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:20.989115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:20.989398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:20.989676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.000005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:20:21.006919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:20:21.008027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 538/1091] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:20:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:20:21.014417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:21.023053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5d603-b5bf-4e74-be10-d6662107e4e7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:21.028079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:21.028756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:21.029039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:21.029317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.030058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:21.030364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:21.031957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:21.039888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 554/1092] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:20:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:21.046466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:21.056216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe0eb2-f9dd-498b-b8ff-a8b65ba0c235 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:21.060688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:21.061501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:21.061787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:21.062065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] PATH_INFO: `/v3/users/1e3eb97736ce404bbf54db1ecbfd272f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.063224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e3eb97736ce404bbf54db1ecbfd272f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:21.065346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:21.067029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 539/1093] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:20:21 2021] GET /identity/v3/users/1e3eb97736ce404bbf54db1ecbfd272f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:21.072705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:21.082450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda3eb8-58d3-4a63-b88e-40a57ff402de admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:21.087040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:21.087658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:21.087939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:21.088224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.096409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:21.098115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:21.106601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 555/1094] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:20:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:20:21.113052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:21.122536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4078-af8d-4b36-bcab-3bb692cbc593 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:21.126950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:21.127787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:21.128075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:21.128390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] PATH_INFO: `/v3/projects/647963c20a404d129c9e30cc363e25e1` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.129545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] RBAC: Authorizing `identity:get_project(project_id=647963c20a404d129c9e30cc363e25e1)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:21.131811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf33d9-3a35-484f-983f-301fc957e087 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:21.133475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 540/1095] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:20:21 2021] GET /identity/v3/projects/647963c20a404d129c9e30cc363e25e1 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:20:21.140412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:20:21.148940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198068-f339-4341-a911-d760c2d71f4e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:20:21.154048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:20:21.154670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:20:21.154954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:20:21.155231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:20:21.156075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=647963c20a404d129c9e30cc363e25e1, user.id=1e3eb97736ce404bbf54db1ecbfd272f) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:20:21.156418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:20:21.158217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e5cae-3732-4904-99a7-5dab7160ce1c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:20:21.163777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 556/1096] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:20:21 2021] GET /identity/v3/role_assignments?user.id=1e3eb97736ce404bbf54db1ecbfd272f&scope.project.id=647963c20a404d129c9e30cc363e25e1&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:41.179372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350d41-9e05-48a8-ba8b-255978bdb5ae None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:41.179966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350d41-9e05-48a8-ba8b-255978bdb5ae None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:41.180117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6350d41-9e05-48a8-ba8b-255978bdb5ae None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:41.181945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 541/1097] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:41.187741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:41.188140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:41.188335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:41.205634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:41.206822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:41.214969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 557/1098] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:41.240739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350d41-9e05-48a8-ba8b-255978bdb5ae None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:41.253058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6350d41-9e05-48a8-ba8b-255978bdb5ae None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:41.257580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:41.258415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:41.258694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:41.258964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:41.268675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:41.270480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:41.287663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:41.288792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 542/1099] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:41.295677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:41.304625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8d8a0-845e-4ea7-a51c-9e4ee134f0fb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:41.309777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:41.309908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:41.310188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:41.310469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:41.311193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:41.311501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:41.313127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3c33-2247-4cd7-b35e-45b102c3ead8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:41.324662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 558/1100] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:41.330838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:41.341327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68504-100c-4ab3-8c35-1852c03c06e9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:41.346220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:41.346862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:41.347145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:41.347418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:41.348094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:41.350043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdf9f2-dcb0-4740-9f32-17616ec151fb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:41.460744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 543/1101] 10.222.0.21 () {60 vars in 1154 bytes} [Tue Aug 10 03:21:41 2021] POST /identity/v3/users => generated 251 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:21:43.621212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065844-dffe-4bd2-b821-b9b04ce6c30b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.621768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065844-dffe-4bd2-b821-b9b04ce6c30b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.621768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065844-dffe-4bd2-b821-b9b04ce6c30b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.623519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 559/1102] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:43.629996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.630513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.630773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.649918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:43.651085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:43.658720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 544/1103] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:43.682746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065844-dffe-4bd2-b821-b9b04ce6c30b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.694826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065844-dffe-4bd2-b821-b9b04ce6c30b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.699751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.700552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.706405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.706405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.711871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:43.718686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:21:43.719815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 560/1104] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:43.726286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.735416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a88b7-79a5-4d50-91d4-2bacdcfa38d8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.741251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.742119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.742541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.742871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.743749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:43.744150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.746588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.754610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 545/1105] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:43.761493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.771231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0469-be11-48f1-9e21-eba830251074 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.776388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.777159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.777445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.777722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.787666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.790009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.806730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:43.807856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 561/1106] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:43.814209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.826775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c38dd-1a00-4c22-b2c3-cf3c0af59517 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.833309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.833309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.833309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.833309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.833707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:43.833707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.833707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.844097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 546/1107] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:43.850391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.866066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67377-bf7e-4b03-89c3-bdef85d73987 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.871278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.872010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.872332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.872611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.879991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.882043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.895394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:43.896544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 562/1108] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:43.902737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.912309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811678-27b5-466d-be39-841ab05a7f47 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.917346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.917996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.918279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.918555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.919377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:43.919685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.921540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.939955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 547/1109] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:43.946193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.955903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9ef95-acca-4ffe-a585-6f0d4e2d5375 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:43.960480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:43.961106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:43.961880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:43.962158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:43.969827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:43.971583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:43.981291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 563/1110] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:21:43.987571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:43.997117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179ede2-a63c-4e18-9743-f14d5f2c6055 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:44.001606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:44.002379 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:44.002664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:44.002943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:44.013151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:44.014970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:44.031551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:44.033099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 548/1111] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:44.039237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:44.048081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b04b-7b75-4cdf-bfc4-8497ef4e8707 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:44.052697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:44.053335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:44.053615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:44.053886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:44.054593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:44.054894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:44.056986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:44.067780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 564/1112] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:44.073880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:44.083898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19a256-6c5f-43e7-8da6-821945cd4c41 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:44.089280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:44.095526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:44.095526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:44.095526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:44.097945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:44.100061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:44.113704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:44.114887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 549/1113] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:44.121950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:44.131156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f3627-10d4-4770-bfb7-9ab1ddf5d6ce admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:44.135722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:44.136409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:44.136694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:44.136968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:44.137737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:44.138043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:44.140007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d03c-6c94-407f-96f2-afd2270b3b76 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:44.152337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 565/1114] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:44.158876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:44.170195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b804e7c-d6db-46e4-aa38-e03b3c14569b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:44.174668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:44.175298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:44.175581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:44.175858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:44.176726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=2fbee68034fe479e8e77af166c12f778) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:44.177040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:44.178854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e286d-4d37-4219-9577-d7cf3f5511f5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:44.184688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 550/1115] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:21:44 2021] GET /identity/v3/role_assignments?user.id=2fbee68034fe479e8e77af166c12f778&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:21:46.283946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a7e-031c-4897-b926-15e5c70e96d8 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.284495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a7e-031c-4897-b926-15e5c70e96d8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.284653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c761a7e-031c-4897-b926-15e5c70e96d8 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.286432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 566/1116] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:46.293064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.293529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.294839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.311144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:46.312353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:46.320178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 551/1117] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:46.343955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c761a7e-031c-4897-b926-15e5c70e96d8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.356544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c761a7e-031c-4897-b926-15e5c70e96d8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.360979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.361707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.361989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.362268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.372876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:46.380011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:21:46.381205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 567/1118] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:46.387735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.396617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ca3fb-7afa-40c0-8ec4-01eaca6ceab7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.401702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.402344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.402623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.402893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.403627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:46.403930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.405578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.413593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 552/1119] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:46.420452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.430438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84869cb-daa5-470c-a0b9-3465eb1ad245 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.434981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.442025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.442025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.442025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.446591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.448450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.464875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:46.466029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 568/1120] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:46.473144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.483459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac386bb1-4199-4467-8b1c-d2aa716bd522 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.488349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.489029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.489318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.489599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.490324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:46.490633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.492225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.503910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 553/1121] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:46.510218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.520169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2924-09ed-4f0d-8586-10918c30f2e1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.525295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.526074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.526358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.526635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.533925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.535911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.549928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:46.553954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 569/1122] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:46.557474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.567054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66633cd5-3246-47fb-8c22-6eb01b48478c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.572120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.572811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.573100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.573380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.574211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:46.574522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.576530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.594921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 554/1123] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:46.601298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.611250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1339e62-5bf6-4dbb-a805-cde9a7b5a91f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.615891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.616707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.616986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.617257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.626996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.628907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.645846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:46.648485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 570/1124] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:46.654048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.663609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28a257-644a-42a5-8d19-958e3ae30d11 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.668049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.668731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.669015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.669292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.670003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:46.670309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.671878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.683435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 555/1125] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:46.689567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.699660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ddcf6-0959-4bb6-993e-7e6f8bdcfdea admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.704280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.705055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.705419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.705695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.712808 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.714733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.727844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:46.729099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 571/1126] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:46.735673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.745790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9b413-4243-4742-90d5-c35ff2ce762a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.751122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.751763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.752049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.752367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.753148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:46.753461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.755534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a43ff-2322-481a-a700-92f7e520e58e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.767844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 556/1127] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:46.774504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:46.785200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fbeb-ca25-4e7b-bb96-7bbb6d62e235 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:46.790190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:46.791121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:46.791396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:46.791665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/2fbee68034fe479e8e77af166c12f778/roles/0aab4c46356d48ddb4fdca522648c309` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:46.806254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=2fbee68034fe479e8e77af166c12f778, role_id=0aab4c46356d48ddb4fdca522648c309)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:46.808999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77aa9a-c9a2-42a5-ab65-b45e6a2110d6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:46.936245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 572/1128] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:21:46 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/2fbee68034fe479e8e77af166c12f778/roles/0aab4c46356d48ddb4fdca522648c309 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:21:49.053265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818426-91f6-4a47-8657-0248b781119e None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.053898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818426-91f6-4a47-8657-0248b781119e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.053898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818426-91f6-4a47-8657-0248b781119e None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.056244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 557/1129] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:49.062082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.062469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.062643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.081222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:49.084469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:49.139984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 573/1130] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:49.163939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818426-91f6-4a47-8657-0248b781119e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.176109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818426-91f6-4a47-8657-0248b781119e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.180941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.181684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.181960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.182228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.192139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:49.198863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 03:21:49.200008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 558/1131] 10.222.0.21 () {56 vars in 1124 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:49.206224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.215520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93edcb-c51f-4d59-af3c-0b504f8ccfab None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.220166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.220842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.221126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.221399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.222135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.222438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.224055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.232531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 574/1132] 10.222.0.21 () {56 vars in 1125 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:49.238604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.248558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb254909-c345-4069-baff-7a66a3a2a2a4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.253329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.256962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.256962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.256962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.265235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.267155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.283678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:49.285912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 559/1133] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:49.291678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.301309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeaf0-a977-4935-8b14-6f0c8a9bbc3d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.305888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.306481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.306764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.307036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.307772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.308076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.309713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.321102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 575/1134] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:49.327442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.337995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa938-a22c-4904-ae85-2363a602fbdf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.342683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.343465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.343862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.344172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.351648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.354233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.367994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:49.369129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 560/1135] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:49.375277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.384937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48016db5-2dab-4d85-adb2-a1131f8327d6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.389371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.390014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.390296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.390566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.391442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.391746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.393693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.411108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 576/1136] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:49.418068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.427657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed7fdd-2d23-4f30-8b89-98d2c08c2804 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.432190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.434970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.434970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.434970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.441022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.442810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.451611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 561/1137] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:21:49.457827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.467939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ebe23-49d5-49e4-8d1d-5d503cb27eb5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.472657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.473435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.473720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.473997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.484610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.486420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.502699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:49.503884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 577/1138] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:49.510409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.519182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d02107-c2d9-435f-a95f-76f89f85dd8f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.524107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.524806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.525087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.525360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.526067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.526371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.527935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.540560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 562/1139] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:49.546864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.556548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb969-ae59-4cba-bd2f-dcc2776c48a0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.561092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.561875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.562251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.562440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.569043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.571537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.584038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:49.585198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 578/1140] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:49.592220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.601724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ed0a-fe7e-4c2c-bc51-ee5e62fa6f7f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.606348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.607056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.607345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.607627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.608482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.608795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.610619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368680f-9507-4025-b9c2-dc184c16cae4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.622870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 563/1141] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:49.629713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:49.640470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300fbd-9aac-48dc-92ea-40d6e5a05512 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:49.645858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:49.646487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:49.646774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:49.647051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:49.647870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] RBAC: Adding query filter params (role.id=0aab4c46356d48ddb4fdca522648c309, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=2fbee68034fe479e8e77af166c12f778) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:49.648183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:49.650797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a06035-7b36-4483-937e-ce3d92762ca0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:49.656584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 579/1142] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:21:49 2021] GET /identity/v3/role_assignments?user.id=2fbee68034fe479e8e77af166c12f778&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=0aab4c46356d48ddb4fdca522648c309 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:51.832990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655626ab-3bcf-4327-b2b5-6eea007b708e None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:51.833729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655626ab-3bcf-4327-b2b5-6eea007b708e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:51.833729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655626ab-3bcf-4327-b2b5-6eea007b708e None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:51.835316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 564/1143] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:51.841813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:51.842250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:51.846750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:51.859297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:51.860503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:51.868109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 580/1144] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:51.893098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655626ab-3bcf-4327-b2b5-6eea007b708e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:51.905598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655626ab-3bcf-4327-b2b5-6eea007b708e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:51.909884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:51.910642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:51.910926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:51.911194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:51.922112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:51.928978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:21:51.930716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 565/1145] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:21:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:51.937253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:51.946428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c8867-367a-46f6-b67b-8d5342b7c2cc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:51.951011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:51.951664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:51.951955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:51.952263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:51.953015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:51.953326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:51.954952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:51.963043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 581/1146] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:21:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:51.969191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:51.979869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b38df-1a7e-4d06-bd93-dc9005484f5d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:51.984474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:51.985274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:51.990218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:51.990218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:51.996578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:51.998397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.015072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:52.016244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 566/1147] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:52.022490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.032281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563288d3-38fc-4c93-84bb-417bb0dfd66e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.038127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.039036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.040315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.041350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:52.041698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.043290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.055866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 582/1148] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:52.062262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.071972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290cd81-f308-4957-9948-eefb4a6bf999 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.076884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.079508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.079508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.079508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.085617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.087570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.101263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:52.102899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 567/1149] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:52.109256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.119938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d1af-70bd-47e8-a781-e7cd05993c4b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.125251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.125407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.125590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.125865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.126696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:52.127007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.128918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.146478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 583/1150] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:52.153000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.162471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ac9de-f422-40f9-b2f2-4df3ae62dcc6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.167378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.168045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.171209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.171209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.176143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.177936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.187272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 568/1151] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:21:52.193537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.203106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b6d58-bfa1-4343-96b5-9e050fc459f0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.207677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.208488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.208776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.209052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.220108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.222874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.238781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:52.239905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 584/1152] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:52.246077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.255397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515412d-8cdc-4ce8-8720-1ca716698f90 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.260319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.260976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.261264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.261571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.262288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:52.262595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.264183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.276015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 569/1153] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:52.282168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.291726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341663-57ce-4faa-aa86-5a227f03139b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.296331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.297103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.297387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.297664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.305473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.307582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.324088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:52.325272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 585/1154] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:52.331710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.341588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64eb2-7514-4661-a536-2e91e022d3dd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.346286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.360071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc44159-be96-43c8-89cb-9a91d43507c4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.362594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 570/1155] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:52.369789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:52.380387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc222d43-9bd2-43f8-bc23-b88857daaef3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:52.385761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:52.386397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:52.386677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:52.386949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:52.387765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=2fbee68034fe479e8e77af166c12f778) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:52.388074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:52.390212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde7923-3fe2-4886-b11a-a88c0c1e3a3b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:52.395684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 586/1156] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:21:52 2021] GET /identity/v3/role_assignments?user.id=2fbee68034fe479e8e77af166c12f778&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:54.561096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf06e-98e8-4de4-bfd0-421e35e9d20f None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.561673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf06e-98e8-4de4-bfd0-421e35e9d20f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.561673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abf06e-98e8-4de4-bfd0-421e35e9d20f None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.563343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 571/1157] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:54.569175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.569601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.569739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.587701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:54.588927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:54.596623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 587/1158] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:54.620474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf06e-98e8-4de4-bfd0-421e35e9d20f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.632922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abf06e-98e8-4de4-bfd0-421e35e9d20f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.637802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.638574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.638859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.639134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.649136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:54.655760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:21:54.658401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 572/1159] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:54.664092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.672646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a65c-dcf8-43a7-9aab-fa13d096dc48 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.677173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.677825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.678111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.678389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.679126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:54.679437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.681565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.689647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 588/1160] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:54.695750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.705659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5dc95-b9ae-4dda-b018-46c06ee6989e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.710726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.711980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.712320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.712596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.723836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.725684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.742231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:54.743358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 573/1161] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:54.749868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.759731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3e807-8a69-48fa-a55b-a12ed7e61add admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.764554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.765216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.765490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.765767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.766484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:54.766794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.768452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.780887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 589/1162] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:54.787085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.797126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e150071-609b-46d4-997c-dd3f9b260a3a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.801587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.802363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.802649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.802926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.810121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.812155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.828093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:54.829359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 574/1163] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:54.835515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.845889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e1b82-9729-4e88-8641-3c14756637b4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.850559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.851211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.852340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.852340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.853530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:54.853851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.855691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.873503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 590/1164] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:54.879984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.890153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7994ab-31ec-4a85-87b2-76f31f71a74c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.894848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.895616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.895897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.898439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.906987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.908846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.925162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:54.926286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 575/1165] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:54.932757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.942555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579cbbb-442d-4c76-b9f1-01692c34c6e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.947746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.948506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.948819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.949136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.949966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:54.950292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.951869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:54.963650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 591/1166] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:54.969937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:54.979921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ec7b6-d94d-4c49-a0ca-bd5227d3d49e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:54.984429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:54.985188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:54.985469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:54.985742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:54.992951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:54.994861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:55.007706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:55.008846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 576/1167] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:55.014983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:55.025103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c254f-afb7-4458-99e3-7ab5b8550127 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:55.029673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:55.030313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:55.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:55.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:55.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:55.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:55.039879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613e5d-6986-4c91-a252-16561edbda9a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:55.045864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 592/1168] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:55.052637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:55.064886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a539d-e071-416f-a7c1-b718e70b0a7e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:55.069304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:55.070157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:55.070485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:55.070810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] PATH_INFO: `/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/2fbee68034fe479e8e77af166c12f778/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:55.072730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d932e1eb838d45edb79d362f44c9e53b, user_id=2fbee68034fe479e8e77af166c12f778, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:55.075370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d958c8-eafb-4e06-bc05-df09daf89df1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:55.164790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 577/1169] 10.222.0.21 () {58 vars in 1461 bytes} [Tue Aug 10 03:21:55 2021] PUT /identity/v3/projects/d932e1eb838d45edb79d362f44c9e53b/users/2fbee68034fe479e8e77af166c12f778/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:21:57.256993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313579f-1697-4cba-ba09-a2644da6ba4c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.257510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313579f-1697-4cba-ba09-a2644da6ba4c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.257623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313579f-1697-4cba-ba09-a2644da6ba4c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.259810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 593/1170] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:21:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:21:57.265531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.265953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.266083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.283574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:21:57.284801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:21:57.340700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 578/1171] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:21:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:21:57.365088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313579f-1697-4cba-ba09-a2644da6ba4c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.377088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313579f-1697-4cba-ba09-a2644da6ba4c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.381721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.382490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.382776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.383543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.393425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 03:21:57.400796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 03:21:57.407342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 594/1172] 10.222.0.21 () {56 vars in 1118 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:57.408795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.417900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f129306-0886-4a2f-9bd2-91fbf9e33a24 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.422625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.423321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.423604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.423946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.424732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.425044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.426633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.435411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 579/1173] 10.222.0.21 () {56 vars in 1121 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:57.441609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.452166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c33d2f-0566-45e1-829a-a5fbea802363 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.456766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.457587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.457906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.458219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.468795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.470603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.486506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:57.491253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 595/1174] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:57.494505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.504446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d28c7-5592-4b07-9b83-44f11180117f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.510117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.510797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.511077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.511352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.512064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.512402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.513959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.525626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 580/1175] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:21:57.532014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.542544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa57ff-bb63-4f60-bef7-b44cd62455ed admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.547001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.548633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.548633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.548633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.555927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.557988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.571844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 03:21:57.577289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 596/1176] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:21:57.579667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.589240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d23eb-f519-4f59-9f7a-595476ee5ff8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.593708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.594349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.594630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.594903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.595766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.596073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.597996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.616025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 581/1177] 10.222.0.21 () {56 vars in 1165 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:57.622849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.632726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2c129-4059-48ff-88d3-93b8d3858610 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.638097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.638722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.639000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.639269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.647443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.649427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.661469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 597/1178] 10.222.0.21 () {58 vars in 1325 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:21:57.668367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.677800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58a2a-60f8-4850-afcf-b46321a15525 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.682807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.683568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.683852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.684125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.695377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.697816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.713838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 03:21:57.714955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 582/1179] 10.222.0.21 () {56 vars in 1130 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:57.721195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.730100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d76a-ce44-4cb1-93b1-9f2ff09774e0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.734850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.735495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.735779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.736053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.736807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.737113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.738687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.750516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 598/1180] 10.222.0.21 () {56 vars in 1131 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:21:57.757488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.769215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f251f6-9c90-4666-9ccb-00b582b855d5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.773797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.774633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.774919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.775195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.781948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.783899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.796985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING keystone.server.flask.application [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 03:21:57.798110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 583/1181] 10.222.0.21 () {56 vars in 1133 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 03:21:57.804743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.814920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c575d-b67b-4d53-bd87-76f8924d2ae8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.819519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.820160 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.821137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.821137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.821548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.821858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.823656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244e445-2cdd-4b22-a175-fd6ed600159b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.835489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 599/1182] 10.222.0.21 () {56 vars in 1170 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:21:57.842409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:21:57.853825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7f028-7c3b-444d-adce-8b8f7acffdb5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:21:57.858338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:21:57.859101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:21:57.859256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:21:57.859537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:21:57.860395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] RBAC: Adding query filter params (role.id=cb3f52d5910b4e919a2580970bca865a, scope.project.id=d932e1eb838d45edb79d362f44c9e53b, user.id=2fbee68034fe479e8e77af166c12f778) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:21:57.860727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:21:57.862527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6a50e-17cb-4dbf-9e2a-461ffa86b666 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:21:57.868929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 584/1183] 10.222.0.21 () {56 vars in 1396 bytes} [Tue Aug 10 03:21:57 2021] GET /identity/v3/role_assignments?user.id=2fbee68034fe479e8e77af166c12f778&scope.project.id=d932e1eb838d45edb79d362f44c9e53b&role.id=cb3f52d5910b4e919a2580970bca865a => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:00.012759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325289-843a-4dca-81e9-2db7a10489db None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:00.013449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325289-843a-4dca-81e9-2db7a10489db None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:00.013739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325289-843a-4dca-81e9-2db7a10489db None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:00.015520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 600/1184] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:22:00.021435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:00.021829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:00.022036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:00.040592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:22:00.041778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:22:00.049546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 585/1185] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:22:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:22:00.073254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325289-843a-4dca-81e9-2db7a10489db None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:00.088388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325289-843a-4dca-81e9-2db7a10489db None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:00.092818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:00.093608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:00.093890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:00.094164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:00.094807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:00.096421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:00.107204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 03:22:00.108354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 601/1186] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:22:00 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:22:00.114996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:00.124113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541eef86-baf3-4e93-82c4-0c5d2e6657ed None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:00.128700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:00.129615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:00.129900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:00.130176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:00.133467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:22:00.133467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:00.133467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4cb3b-4a34-49d8-b2b6-ddba59e895cb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:00.137970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 586/1187] 10.222.0.21 () {56 vars in 1138 bytes} [Tue Aug 10 03:22:00 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:00.144087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:00.154080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e6a24-2cb8-4ae4-9512-0d8f00e92e71 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:00.158520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:00.159153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:00.159434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:00.159708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] PATH_INFO: `/v3/services` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:00.160430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:22:00.160734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:00.162298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fea8-8963-46e6-abcf-725f0433a66a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:00.166771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 602/1188] 10.222.0.21 () {56 vars in 1138 bytes} [Tue Aug 10 03:22:00 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:02.314841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c754-ad51-4329-9b68-a46651279b88 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:02.315375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c754-ad51-4329-9b68-a46651279b88 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:02.315375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421c754-ad51-4329-9b68-a46651279b88 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:02.317201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 587/1189] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:22:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:22:02.323562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a872a-5db5-4ac8-a485-70be0a6f59bc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:02.323993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a872a-5db5-4ac8-a485-70be0a6f59bc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:02.324118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a872a-5db5-4ac8-a485-70be0a6f59bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:02.342079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0c3a872a-5db5-4ac8-a485-70be0a6f59bc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:22:02.343268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0c3a872a-5db5-4ac8-a485-70be0a6f59bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:22:02.350916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 603/1190] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:22:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:22:02.374648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c754-ad51-4329-9b68-a46651279b88 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:02.387415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421c754-ad51-4329-9b68-a46651279b88 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:02.391792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:02.392493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:02.392764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:02.393039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:02.393760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:02.395327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92279a4-8f99-44dc-96df-bbb19ce611c9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:02.496860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 588/1191] 10.222.0.21 () {60 vars in 1163 bytes} [Tue Aug 10 03:22:02 2021] POST /identity/v3/services => generated 246 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:22:04.619419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764355c-eaea-4e4c-9650-25b96ae8e9ba None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.619958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764355c-eaea-4e4c-9650-25b96ae8e9ba None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.619958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764355c-eaea-4e4c-9650-25b96ae8e9ba None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.621787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 604/1192] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:22:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:22:04.627928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.628446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.628553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.646975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:22:04.648152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:22:04.666678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 589/1193] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:22:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:22:04.691007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764355c-eaea-4e4c-9650-25b96ae8e9ba None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:04.703895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764355c-eaea-4e4c-9650-25b96ae8e9ba None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:04.708397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:04.715341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.715341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.715341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.715341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:04.715341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:04.723222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 03:22:04.724348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 605/1194] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:22:04 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:22:04.730626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:04.739442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc768e9-8923-4def-a5e2-dee87ef59e56 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:04.743940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:04.744620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.744907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.745185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.745917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:22:04.746221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:04.747852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:04.753241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 590/1195] 10.222.0.21 () {56 vars in 1138 bytes} [Tue Aug 10 03:22:04 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:04.760485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:04.770021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cc40e-c70c-4540-b1b5-5012251e210c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:04.775240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:04.775872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.776159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.776477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.777258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] RBAC: Adding query filter params (interface=public, service_id=66926e205b7d46b3af0b84bfce65d374, region_id=RegionOne) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:22:04.777571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:04.779147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9cc85-0609-4c1d-8abe-6e762db8a777 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:04.783988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 606/1196] 10.222.0.21 () {56 vars in 1273 bytes} [Tue Aug 10 03:22:04 2021] GET /identity/v3/endpoints?service_id=66926e205b7d46b3af0b84bfce65d374&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:04.790062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:04.799724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7794d-dd03-4f67-b817-55ea4c040aa0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:04.804293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfbc97-adca-4a21-bc4e-821d63fe3eb7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:04.847189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 591/1197] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:22:04 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:22:06.978619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84ce1-f4a0-49f0-add5-98b0d76a2411 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:06.979199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84ce1-f4a0-49f0-add5-98b0d76a2411 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:06.979199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee84ce1-f4a0-49f0-add5-98b0d76a2411 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:06.981084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 607/1198] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:22:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:22:06.986974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:06.987394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:06.987576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:07.005662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:22:07.006838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:22:07.014493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 592/1199] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:22:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:22:07.038274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee84ce1-f4a0-49f0-add5-98b0d76a2411 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:07.051259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee84ce1-f4a0-49f0-add5-98b0d76a2411 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:07.056644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:07.057439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:07.057721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:07.058002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:07.058693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:07.060465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:07.071698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING keystone.server.flask.application [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 03:22:07.072843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 608/1200] 10.222.0.21 () {56 vars in 1139 bytes} [Tue Aug 10 03:22:07 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 03:22:07.079418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:07.088911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449f2b2-ae36-444b-aeff-59052d573ef6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:07.093391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:07.094034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:07.094317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:07.094593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] PATH_INFO: `/v3/services` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:07.095289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:22:07.095596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:07.097196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf821d6-577f-40f9-ab7e-3e1b1da8ff2d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:07.103289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 593/1201] 10.222.0.21 () {56 vars in 1138 bytes} [Tue Aug 10 03:22:07 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:22:07.109661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:22:07.120719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423693b6-1b4c-4c8e-86a9-29687ad80631 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:22:07.125543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:22:07.131112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:22:07.131112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:22:07.131112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:22:07.131112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:22:07.131112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584828-3dfa-474d-9502-5cc40c45b04d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:22:07.282629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 609/1202] 10.222.0.21 () {60 vars in 1166 bytes} [Tue Aug 10 03:22:07 2021] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:30:31.524392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:31.525567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:31.525868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:31.528084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 594/1203] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:31.534876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef787-979d-480f-9f8d-76af54d325f6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:31.535487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef787-979d-480f-9f8d-76af54d325f6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:31.535487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef787-979d-480f-9f8d-76af54d325f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:31.610814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b16ef787-979d-480f-9f8d-76af54d325f6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:31.612005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b16ef787-979d-480f-9f8d-76af54d325f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:31.735179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 610/1204] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:31.775023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:31.777780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:31.942465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b0bd3-1e48-458f-b0a8-864c4050418d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:32.046459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:32.047024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:32.047432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:32.047775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:32.048684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:32.051164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0650be-a095-4011-888b-2ae74a9cf276 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:32.071954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 595/1205] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:30:31 2021] GET /identity/v3/projects => generated 2553 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:30:34.288022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7495ca-e4e6-453b-95de-4ebb8c6131fc None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:34.288659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7495ca-e4e6-453b-95de-4ebb8c6131fc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:34.288659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7495ca-e4e6-453b-95de-4ebb8c6131fc None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:34.290405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 611/1206] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:34.296696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a32b-da1c-4b7b-ae10-81ccda52ba0b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:34.297231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a32b-da1c-4b7b-ae10-81ccda52ba0b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:34.297355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566a32b-da1c-4b7b-ae10-81ccda52ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:34.392248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3566a32b-da1c-4b7b-ae10-81ccda52ba0b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:34.393567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3566a32b-da1c-4b7b-ae10-81ccda52ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:34.488827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 596/1207] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:34.540772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28507-6520-46a0-a638-6f25244e25da None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:34.540772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28507-6520-46a0-a638-6f25244e25da None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:34.541940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28507-6520-46a0-a638-6f25244e25da None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:34.542853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 612/1208] 10.222.0.21 () {54 vars in 964 bytes} [Tue Aug 10 03:30:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:34.549740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db01af-71bb-48c8-9b37-e9fb7f84eeca None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:34.550036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db01af-71bb-48c8-9b37-e9fb7f84eeca None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:34.550319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db01af-71bb-48c8-9b37-e9fb7f84eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:34.636331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-90db01af-71bb-48c8-9b37-e9fb7f84eeca None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:34.637568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-90db01af-71bb-48c8-9b37-e9fb7f84eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:34.715363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 597/1209] 10.222.0.21 () {58 vars in 1062 bytes} [Tue Aug 10 03:30:34 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:34.725303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28507-6520-46a0-a638-6f25244e25da None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:34.726835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-aac28507-6520-46a0-a638-6f25244e25da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:34.827127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28507-6520-46a0-a638-6f25244e25da None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:34.897716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:34.898366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:34.898647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:34.898921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:34.900577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:35.005060 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:35.006502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e62f0-e095-428b-9d64-a8a5c3a0fb8d service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:35.024457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 613/1210] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:37.392488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:37.393025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:37.393149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:37.394834 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 598/1211] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:37.400727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be932747-699d-4339-a350-421699fcaef6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:37.401129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be932747-699d-4339-a350-421699fcaef6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:37.401287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be932747-699d-4339-a350-421699fcaef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:37.463435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-be932747-699d-4339-a350-421699fcaef6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:37.464678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-be932747-699d-4339-a350-421699fcaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:37.556128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 614/1212] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:37.595114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:37.596720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:37.703617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4ce89-b4e4-42d1-9e02-88a1a68a3166 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:37.777263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:37.777933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:37.778215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:37.778491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:37.780226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:37.886085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:37.887515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae23877-c594-47cf-9731-558c2685f575 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:37.905766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 599/1213] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:40.771130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:40.771669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:40.771669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:40.773592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 615/1214] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:40.779395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14101-c977-40cb-b38d-953539269e0d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:40.779787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14101-c977-40cb-b38d-953539269e0d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:40.779939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb14101-c977-40cb-b38d-953539269e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:40.844702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2eb14101-c977-40cb-b38d-953539269e0d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:40.845901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2eb14101-c977-40cb-b38d-953539269e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:40.940715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 600/1215] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:40.976475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:40.978154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:41.114764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb8717-b755-4dd3-b982-1f130bfb6491 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:41.208012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:41.208907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:41.209191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:41.209466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:41.220061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:41.222165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97447540-1696-4851-ac2a-34e2405f568e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:41.223947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 616/1216] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:30:40 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:30:41.253811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:41.254146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:41.254425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:41.256251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 601/1217] 10.222.0.21 () {54 vars in 964 bytes} [Tue Aug 10 03:30:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:41.262948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76822-fc53-48c7-ae13-216a130f0c91 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:41.263241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76822-fc53-48c7-ae13-216a130f0c91 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:41.263527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76822-fc53-48c7-ae13-216a130f0c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:41.338259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b6d76822-fc53-48c7-ae13-216a130f0c91 None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:41.339486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b6d76822-fc53-48c7-ae13-216a130f0c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:41.413468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 617/1218] 10.222.0.21 () {58 vars in 1062 bytes} [Tue Aug 10 03:30:41 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:41.423256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:41.424827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:41.528955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28011-a58f-40cf-ad6d-c4a9ee7fa1d6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:41.602293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:41.602950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:41.603241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:41.603519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:41.605186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:41.716030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:41.717416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164e2b0-8002-481c-8dd5-38992bf4d153 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:41.735455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 602/1219] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:45.243611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:45.244165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:45.244165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:45.246016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 618/1220] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:45.252746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:45.253178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:45.253334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:45.317335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:45.318540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:45.412118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 603/1221] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:45.446379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:45.447911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:45.567687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0648-1144-4d02-aaff-19cc2cae218b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:45.656951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:45.657809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:45.658092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:45.658365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:45.667933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:45.669973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303a413-d8f9-4d97-9cde-7d2fe5274b3f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:45.671743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 619/1222] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:30:45 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:30:45.688417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:45.689649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:45.781726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12880c2-9a74-4805-9df7-88a8410bc8d4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:45.853495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:45.854142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:45.854427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:45.854728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:45.856377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:45.961582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:45.962930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07931d56-e302-48a0-9fac-4052145742a4 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:45.980290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 604/1223] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:49.313559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:49.314090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:49.314090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:49.316015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 620/1224] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:49.322034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e572e7d-f95e-4352-8ce6-22bc87b92467 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:49.322458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e572e7d-f95e-4352-8ce6-22bc87b92467 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:49.322598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e572e7d-f95e-4352-8ce6-22bc87b92467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:49.390050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1e572e7d-f95e-4352-8ce6-22bc87b92467 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:49.391332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1e572e7d-f95e-4352-8ce6-22bc87b92467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:49.493875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 605/1225] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:49.532390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:49.534130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:49.640943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dd119-4783-462a-9199-5bb8f7bcb3d3 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:49.715737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:49.716420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:49.716705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:49.716980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:49.718832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:49.835002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:49.836503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7212d-8aab-424b-8706-1d75ab0d061c service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:49.856613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 621/1226] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:52.109664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372462-599b-4770-916e-736fa5985621 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:52.109664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372462-599b-4770-916e-736fa5985621 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:52.109664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb372462-599b-4770-916e-736fa5985621 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:52.109664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 606/1227] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:52.117006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81383f5-e5f9-4fe7-b328-d4984a99bef3 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:52.117006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81383f5-e5f9-4fe7-b328-d4984a99bef3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:52.126950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81383f5-e5f9-4fe7-b328-d4984a99bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:52.192031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c81383f5-e5f9-4fe7-b328-d4984a99bef3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:52.193360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c81383f5-e5f9-4fe7-b328-d4984a99bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:52.295164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 622/1228] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:52.333351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb372462-599b-4770-916e-736fa5985621 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:52.334889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cb372462-599b-4770-916e-736fa5985621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:52.443206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb372462-599b-4770-916e-736fa5985621 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:52.526535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:52.527100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:52.527378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:52.527655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:52.529404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:52.648175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:52.649657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d472dd-338c-4d4e-86ab-d6db3c6d981f service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:52.668068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 607/1229] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:54.881911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:54.882447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:54.882447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:54.884356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 623/1230] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:54.891312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:54.891835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:54.892003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:54.960848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:54.962086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:55.063978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 608/1231] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:55.096708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:55.098290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:55.223369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf7a1-5af2-422f-a3b7-2f279ffa7059 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:55.325272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:55.326133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:55.326420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:55.326691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:55.337005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:55.339060 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139b7bc-0ee5-4143-83c0-7947e314c5ce admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:55.340804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 624/1232] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:30:55 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:30:55.353455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:55.354658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:55.443901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b51b33-a1db-4c4a-bebf-cbc7a25efe37 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:55.520062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:55.520820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:55.521103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:55.521380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:55.522984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:55.638115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:55.639568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfb849-164a-493b-8514-4bd2ca9dee6f service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:55.658530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 609/1233] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:30:58.550196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:58.550759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:58.550759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:58.552579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 625/1234] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:30:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:30:58.558679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ff95-74f0-4102-8bdc-4d82438a1480 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:58.559177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ff95-74f0-4102-8bdc-4d82438a1480 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:58.559271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512ff95-74f0-4102-8bdc-4d82438a1480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:58.627150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f512ff95-74f0-4102-8bdc-4d82438a1480 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:30:58.628404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f512ff95-74f0-4102-8bdc-4d82438a1480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:58.725481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 610/1235] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:30:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:30:58.762253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:30:58.763883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:58.865395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94955c2d-6145-44c6-a3fd-769839fadbdb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:30:58.939036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:30:58.939693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:30:58.939975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:30:58.940275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:30:58.941921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:30:59.049329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:30:59.050796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3ccb9-299c-40e8-a072-8f461615dbb9 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:30:59.068864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 626/1236] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:30:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:01.273157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:01.273769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:01.273769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:01.275660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 611/1237] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:01.281874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3414c-841a-49ff-af61-b9ef74665193 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:01.282313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3414c-841a-49ff-af61-b9ef74665193 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:01.282440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3414c-841a-49ff-af61-b9ef74665193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:01.353568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b5f3414c-841a-49ff-af61-b9ef74665193 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:01.354782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b5f3414c-841a-49ff-af61-b9ef74665193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:01.472733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 627/1238] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:01.513513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:01.515042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:01.631515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc5db0-53ae-44ac-b53c-9be002e39d84 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:01.709147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:01.709705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:01.709991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:01.710262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:01.711870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:01.823408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:01.824870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755039a3-84db-4f8f-b03e-8d2ec4c3330b service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:01.843606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 612/1239] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:04.742171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:04.742813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:04.742813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:04.744547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 628/1240] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:31:04.751355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd21f64-f402-423d-a19a-d5d248e19d47 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:04.751839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd21f64-f402-423d-a19a-d5d248e19d47 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:04.751933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd21f64-f402-423d-a19a-d5d248e19d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:04.822228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6bd21f64-f402-423d-a19a-d5d248e19d47 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:04.823466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6bd21f64-f402-423d-a19a-d5d248e19d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:04.934336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 613/1241] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:04.971863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:04.974607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:05.074298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ef594-81ad-4cf6-83f5-9bb536547781 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:05.078515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:05.079165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:05.079449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:05.079724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:05.090253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:05.096827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3bba4-25ba-473a-8a83-94939df7274d service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:05.101482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 629/1242] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:09.786194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd404d-3214-452b-966e-7fd2b792fc00 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:09.786700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd404d-3214-452b-966e-7fd2b792fc00 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:09.786700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd404d-3214-452b-966e-7fd2b792fc00 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:09.788467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 614/1243] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:09.794573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3d13-b176-4c3c-90e2-7ab4f9da5c51 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:09.795129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3d13-b176-4c3c-90e2-7ab4f9da5c51 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:09.795270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3d13-b176-4c3c-90e2-7ab4f9da5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:09.813456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-69dd3d13-b176-4c3c-90e2-7ab4f9da5c51 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:09.814651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-69dd3d13-b176-4c3c-90e2-7ab4f9da5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:09.822517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 630/1244] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:09.865906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd404d-3214-452b-966e-7fd2b792fc00 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:09.882426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd404d-3214-452b-966e-7fd2b792fc00 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:09.886384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:09.887042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:09.887327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:09.887601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:09.898107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:09.900015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b1f3d-0ca1-4b38-b567-43d97aa69410 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:09.911272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 615/1245] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:13.310825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282f16-078e-4c08-96d0-ddc436e4ded1 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:13.311378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282f16-078e-4c08-96d0-ddc436e4ded1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:13.311506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282f16-078e-4c08-96d0-ddc436e4ded1 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:13.314249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 631/1246] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:13.321027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d6c5-10f2-4abc-a345-833f353b0c6c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:13.321555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d6c5-10f2-4abc-a345-833f353b0c6c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:13.321662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368d6c5-10f2-4abc-a345-833f353b0c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:13.340909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7368d6c5-10f2-4abc-a345-833f353b0c6c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:13.342124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7368d6c5-10f2-4abc-a345-833f353b0c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:13.350186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 616/1247] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:13.391563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282f16-078e-4c08-96d0-ddc436e4ded1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:13.402821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282f16-078e-4c08-96d0-ddc436e4ded1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:13.406408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:13.407047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:13.407331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:13.407608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:13.416684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:13.418124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd4357-cfe7-426f-ac56-00801bca79e5 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:13.427912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 632/1248] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:31:18.368579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:18.369102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:18.369102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:18.371185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 617/1249] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:18.378724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca5a8-bab5-43c6-9df8-2daf18fb579d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:18.379312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca5a8-bab5-43c6-9df8-2daf18fb579d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:18.379408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca5a8-bab5-43c6-9df8-2daf18fb579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:18.399323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-765ca5a8-bab5-43c6-9df8-2daf18fb579d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:18.401205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-765ca5a8-bab5-43c6-9df8-2daf18fb579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:18.412832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 633/1250] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:18.457572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:18.459494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:18.472774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c9d38-4373-4e36-8a9f-a5ceadcfda1f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:18.476989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:18.477647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:18.477934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:18.478210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:18.487999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:18.489481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6bdd-9680-49c4-9d7d-5cd4ffef5fe0 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:18.500537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 618/1251] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:23.517850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378144d-e790-4357-8c52-d47a38e3bf11 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:23.518387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378144d-e790-4357-8c52-d47a38e3bf11 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:23.518387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378144d-e790-4357-8c52-d47a38e3bf11 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:23.524920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 634/1252] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:31:23 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:23.535005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8aea-71fd-4a8a-aa17-3204c7b3bedf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:23.536097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8aea-71fd-4a8a-aa17-3204c7b3bedf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:23.538502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8aea-71fd-4a8a-aa17-3204c7b3bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:23.641226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f2db8aea-71fd-4a8a-aa17-3204c7b3bedf None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:23.642446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f2db8aea-71fd-4a8a-aa17-3204c7b3bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:23.759499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 619/1253] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:31:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:23.941795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9200c5-1265-4cfc-9f87-e2482baf0644 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:23.942154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9200c5-1265-4cfc-9f87-e2482baf0644 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:23.942357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9200c5-1265-4cfc-9f87-e2482baf0644 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:23.944601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 635/1254] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:23.952974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757af9e9-44d1-4d7c-a75f-702d86ad6955 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:23.953542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757af9e9-44d1-4d7c-a75f-702d86ad6955 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:23.954085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757af9e9-44d1-4d7c-a75f-702d86ad6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:23.974962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-757af9e9-44d1-4d7c-a75f-702d86ad6955 None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:23.976603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-757af9e9-44d1-4d7c-a75f-702d86ad6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:23.992995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 620/1255] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:31:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:28.492581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8c55-eb45-484e-b775-11799b079771 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:28.493156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8c55-eb45-484e-b775-11799b079771 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:28.493785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8c55-eb45-484e-b775-11799b079771 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:28.496181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 636/1256] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:31:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:28.502796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171765-3689-4530-8847-f73ce8b11557 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:28.503352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171765-3689-4530-8847-f73ce8b11557 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:28.503352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9171765-3689-4530-8847-f73ce8b11557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:28.523207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f9171765-3689-4530-8847-f73ce8b11557 None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:28.524480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f9171765-3689-4530-8847-f73ce8b11557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:28.533698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 621/1257] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:31:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:29.921987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b02cd-6e11-418c-a8c0-a653bfefde5c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:29.922532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b02cd-6e11-418c-a8c0-a653bfefde5c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:29.922532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b02cd-6e11-418c-a8c0-a653bfefde5c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:29.924355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 637/1258] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:31:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:29.929778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dbb34-27d8-49ad-9214-8414a5bd60b9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:29.930212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dbb34-27d8-49ad-9214-8414a5bd60b9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:29.930352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dbb34-27d8-49ad-9214-8414a5bd60b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:29.948761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-589dbb34-27d8-49ad-9214-8414a5bd60b9 None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:29.949972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-589dbb34-27d8-49ad-9214-8414a5bd60b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:29.959460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 622/1259] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:31:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:33.777497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd15438-6c13-4602-8bce-f02d49fbcf6c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:33.778237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd15438-6c13-4602-8bce-f02d49fbcf6c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:33.778237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd15438-6c13-4602-8bce-f02d49fbcf6c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:33.781345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 638/1260] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:33.788088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24864cd4-a3bc-4383-b581-c22f7c5cb375 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:33.788961 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24864cd4-a3bc-4383-b581-c22f7c5cb375 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:33.789526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24864cd4-a3bc-4383-b581-c22f7c5cb375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:33.813071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-24864cd4-a3bc-4383-b581-c22f7c5cb375 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:33.814616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-24864cd4-a3bc-4383-b581-c22f7c5cb375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:33.822729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 623/1261] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:33.878531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c170c-f6c7-4ce0-bb1b-ed97b51b9af3 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:33.878531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c170c-f6c7-4ce0-bb1b-ed97b51b9af3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:33.878531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c170c-f6c7-4ce0-bb1b-ed97b51b9af3 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:33.879551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 639/1262] 10.222.0.21 () {54 vars in 961 bytes} [Tue Aug 10 03:31:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:33.887741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add1f3c-19f4-4c43-97eb-5f7939f39b92 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:33.888124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add1f3c-19f4-4c43-97eb-5f7939f39b92 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:33.888581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add1f3c-19f4-4c43-97eb-5f7939f39b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:33.938969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3add1f3c-19f4-4c43-97eb-5f7939f39b92 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:33.940177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3add1f3c-19f4-4c43-97eb-5f7939f39b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:34.023105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 624/1263] 10.222.0.21 () {58 vars in 1059 bytes} [Tue Aug 10 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:34.031174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c170c-f6c7-4ce0-bb1b-ed97b51b9af3 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:34.047609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c170c-f6c7-4ce0-bb1b-ed97b51b9af3 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:34.053546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:34.054416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:34.054770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:34.055115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:34.064165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:34.065879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a0ee6-72d6-488c-99d7-4810e81dd6e9 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:34.077254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 640/1264] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:36.444187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac951-5a89-47e0-84de-31798284b61c None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:36.444769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac951-5a89-47e0-84de-31798284b61c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:36.444769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac951-5a89-47e0-84de-31798284b61c None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:36.446545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 625/1265] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:36.452896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7e85-182b-40df-8e87-dbb68863a99a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:36.453793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7e85-182b-40df-8e87-dbb68863a99a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:36.454062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c7e85-182b-40df-8e87-dbb68863a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:36.473657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0c2c7e85-182b-40df-8e87-dbb68863a99a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:36.495106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0c2c7e85-182b-40df-8e87-dbb68863a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:36.495106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 641/1266] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:36.535160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac951-5a89-47e0-84de-31798284b61c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:36.564218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac951-5a89-47e0-84de-31798284b61c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:36.573236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:36.574288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:36.574767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:36.575240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:36.585248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:36.586910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064ad4b-18d9-472b-a179-a16f1bef5df5 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:36.598503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 626/1267] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:39.202797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa35d-0aea-47a0-950c-45c7c03e6205 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:39.203254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa35d-0aea-47a0-950c-45c7c03e6205 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:39.203402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa35d-0aea-47a0-950c-45c7c03e6205 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:39.205280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 642/1268] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:39.211258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357222d-cdc9-4565-9f88-dc51d3b0f7a0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:39.211740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357222d-cdc9-4565-9f88-dc51d3b0f7a0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:39.211868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357222d-cdc9-4565-9f88-dc51d3b0f7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:39.229583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0357222d-cdc9-4565-9f88-dc51d3b0f7a0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:39.230742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0357222d-cdc9-4565-9f88-dc51d3b0f7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:39.240337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 627/1269] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:39.295808 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e74b54-b4fd-4375-8f73-9107a96a3e7e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:39.296152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e74b54-b4fd-4375-8f73-9107a96a3e7e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:39.296443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e74b54-b4fd-4375-8f73-9107a96a3e7e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:39.298586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 643/1270] 10.222.0.21 () {54 vars in 961 bytes} [Tue Aug 10 03:31:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:39.304720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27414-6a44-474f-843e-49d4f574e92b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:39.304971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27414-6a44-474f-843e-49d4f574e92b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:39.305436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27414-6a44-474f-843e-49d4f574e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:39.329641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c9a27414-6a44-474f-843e-49d4f574e92b None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:39.330939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c9a27414-6a44-474f-843e-49d4f574e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:39.340969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 628/1271] 10.222.0.21 () {58 vars in 1059 bytes} [Tue Aug 10 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:39.351331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e74b54-b4fd-4375-8f73-9107a96a3e7e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:39.366510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e74b54-b4fd-4375-8f73-9107a96a3e7e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:39.372168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:39.372846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:39.373138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:39.374022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:39.390220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:39.392508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfae3c-b100-4d93-ad02-c99090767561 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:39.404369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 644/1272] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:41.875397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e35c3-e93d-4db7-b5be-0d7a986d286d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:41.876233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e35c3-e93d-4db7-b5be-0d7a986d286d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:41.876233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e35c3-e93d-4db7-b5be-0d7a986d286d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:41.878363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 629/1273] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:41.884335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25b07c-9f0e-499f-85b1-221ba03d2976 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:41.884774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25b07c-9f0e-499f-85b1-221ba03d2976 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:41.884901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25b07c-9f0e-499f-85b1-221ba03d2976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:41.903706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-aa25b07c-9f0e-499f-85b1-221ba03d2976 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:41.905634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-aa25b07c-9f0e-499f-85b1-221ba03d2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:41.914252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 645/1274] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:41.960776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e35c3-e93d-4db7-b5be-0d7a986d286d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:41.976917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e35c3-e93d-4db7-b5be-0d7a986d286d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:41.984471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:41.985541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:41.986025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:41.986468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.003445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:42.005380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64625973-d3eb-40c3-b273-e6cae10a54ec service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:42.017116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 630/1275] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:42.040543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96251b-3ce6-4aa1-b3ba-ba0fcc12707c None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:42.041710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96251b-3ce6-4aa1-b3ba-ba0fcc12707c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:42.041710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96251b-3ce6-4aa1-b3ba-ba0fcc12707c None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.043046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 646/1276] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:42.049858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6b4b-7c13-415c-9761-94a97e6386a6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:42.050159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6b4b-7c13-415c-9761-94a97e6386a6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:42.050446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c6b4b-7c13-415c-9761-94a97e6386a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.069009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-086c6b4b-7c13-415c-9761-94a97e6386a6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:42.070235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-086c6b4b-7c13-415c-9761-94a97e6386a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:42.079030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 631/1277] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:42.137281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf7bb-8bc7-431c-9da3-637e7b641432 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:42.137555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf7bb-8bc7-431c-9da3-637e7b641432 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:42.137835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cf7bb-8bc7-431c-9da3-637e7b641432 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.140111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 647/1278] 10.222.0.21 () {54 vars in 966 bytes} [Tue Aug 10 03:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:42.146663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03c27-8cf5-4c3f-972a-153a1f74e30d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:42.147031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03c27-8cf5-4c3f-972a-153a1f74e30d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:42.152492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03c27-8cf5-4c3f-972a-153a1f74e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.209809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c6c03c27-8cf5-4c3f-972a-153a1f74e30d None None] MFA Rules not processed for user `175949d4ebc945cdb0b0a43c8b223f16`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:42.211318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c6c03c27-8cf5-4c3f-972a-153a1f74e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:42.272622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 632/1279] 10.222.0.21 () {58 vars in 1064 bytes} [Tue Aug 10 03:31:42 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:42.281337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf7bb-8bc7-431c-9da3-637e7b641432 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:42.292759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cf7bb-8bc7-431c-9da3-637e7b641432 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:42.296398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:42.297094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:42.297506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:42.297830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:42.317125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:42.317125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5923-b283-418a-b8e9-e38042ef2d58 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:42.324785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 648/1280] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:31:44.543521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7fe38-e66e-4ec8-9db7-128345ee216d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:44.543969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7fe38-e66e-4ec8-9db7-128345ee216d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:44.544158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7fe38-e66e-4ec8-9db7-128345ee216d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:44.546856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 633/1281] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:44.553551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07174-4623-44e2-ab7b-7befb2be9b52 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:44.554025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07174-4623-44e2-ab7b-7befb2be9b52 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:44.554149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07174-4623-44e2-ab7b-7befb2be9b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:44.573053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-34e07174-4623-44e2-ab7b-7befb2be9b52 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:44.574263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-34e07174-4623-44e2-ab7b-7befb2be9b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:44.582524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 649/1282] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:44.629751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7fe38-e66e-4ec8-9db7-128345ee216d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:44.644823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7fe38-e66e-4ec8-9db7-128345ee216d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:44.651068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:44.651707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:44.652038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:44.652362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:44.661679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:44.663176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057de64-cc64-44b5-a019-136242f09ed6 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:44.674187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 634/1283] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:47.122674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee54a7-b1cf-49b4-9bff-f182dde13274 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:47.123813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee54a7-b1cf-49b4-9bff-f182dde13274 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:47.123813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee54a7-b1cf-49b4-9bff-f182dde13274 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:47.125589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 650/1284] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:47.131874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cb9b6-d1ac-43c6-850f-52857ae79e39 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:47.132425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cb9b6-d1ac-43c6-850f-52857ae79e39 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:47.132425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cb9b6-d1ac-43c6-850f-52857ae79e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:47.151595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ae0cb9b6-d1ac-43c6-850f-52857ae79e39 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:47.153012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ae0cb9b6-d1ac-43c6-850f-52857ae79e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:47.161351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 635/1285] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:47.209985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee54a7-b1cf-49b4-9bff-f182dde13274 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:47.225595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee54a7-b1cf-49b4-9bff-f182dde13274 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:47.231733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:47.232523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:47.232905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:47.233376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:47.242613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:47.245169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7956-2d67-4802-b6f7-daa65829486d service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:47.256417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 651/1286] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:49.725216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9195-98c7-4312-8037-d23e6a7a3b41 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:49.725749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9195-98c7-4312-8037-d23e6a7a3b41 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:49.725842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b9195-98c7-4312-8037-d23e6a7a3b41 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:49.727736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 636/1287] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:31:49.734686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d46d4-7f9a-47a0-8585-1348813a8ec3 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:49.735363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d46d4-7f9a-47a0-8585-1348813a8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:49.735363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d46d4-7f9a-47a0-8585-1348813a8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:49.773986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9a8d46d4-7f9a-47a0-8585-1348813a8ec3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:49.775720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9a8d46d4-7f9a-47a0-8585-1348813a8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:49.789306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 652/1288] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:49.871210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b9195-98c7-4312-8037-d23e6a7a3b41 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:49.895577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b9195-98c7-4312-8037-d23e6a7a3b41 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:49.905234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:49.906093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:49.906723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:49.906723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:49.923697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:49.926690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c7479-11b7-4186-939a-8996946d9ca5 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:49.946887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 637/1289] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:52.749848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585cbe-0eb1-488b-94b1-0966c6b511f8 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:52.750397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585cbe-0eb1-488b-94b1-0966c6b511f8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:52.750540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585cbe-0eb1-488b-94b1-0966c6b511f8 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:52.752896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 653/1290] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:31:52.759224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fe8d-4408-41b6-9d81-2f073acb0cf1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:52.759671 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fe8d-4408-41b6-9d81-2f073acb0cf1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:52.759767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5fe8d-4408-41b6-9d81-2f073acb0cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:52.779329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d9e5fe8d-4408-41b6-9d81-2f073acb0cf1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:52.780906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d9e5fe8d-4408-41b6-9d81-2f073acb0cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:52.789898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 638/1291] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:52.840725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585cbe-0eb1-488b-94b1-0966c6b511f8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:52.860439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585cbe-0eb1-488b-94b1-0966c6b511f8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:52.867651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:52.868536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:52.868893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:52.869251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:52.881733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:52.884996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f29435-4cac-43c7-be0c-1c743f9551c3 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:52.902130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 654/1292] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:31:55.378233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc353-3a37-41cf-9172-4c2944364883 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:55.378780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc353-3a37-41cf-9172-4c2944364883 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:55.378962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc353-3a37-41cf-9172-4c2944364883 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:55.381094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 639/1293] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:31:55.387841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3950-82c3-4abf-8b04-2aa21056a118 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:55.388507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3950-82c3-4abf-8b04-2aa21056a118 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:55.388507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3950-82c3-4abf-8b04-2aa21056a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:55.407264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9fcd3950-82c3-4abf-8b04-2aa21056a118 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:55.408505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9fcd3950-82c3-4abf-8b04-2aa21056a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:55.417303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 655/1294] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:55.465506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc353-3a37-41cf-9172-4c2944364883 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:55.482406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc353-3a37-41cf-9172-4c2944364883 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:55.488932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:55.489595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:55.489884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:55.490161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:55.501313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:55.502937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da7998-03cc-4a70-9cb4-fc2417a4271d service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:55.513667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 640/1295] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:57.928772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ebcb-30bf-4900-85d7-ce9ba82187ee None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:57.929277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ebcb-30bf-4900-85d7-ce9ba82187ee None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:57.929277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5ebcb-30bf-4900-85d7-ce9ba82187ee None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:57.931211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 656/1296] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:57.937454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e355-b99b-4d48-af82-fa6ab8736e64 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:57.937910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e355-b99b-4d48-af82-fa6ab8736e64 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:57.938040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640e355-b99b-4d48-af82-fa6ab8736e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:57.957773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6640e355-b99b-4d48-af82-fa6ab8736e64 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:57.958967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6640e355-b99b-4d48-af82-fa6ab8736e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:57.968006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 641/1297] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:58.016753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ebcb-30bf-4900-85d7-ce9ba82187ee None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:58.032510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5ebcb-30bf-4900-85d7-ce9ba82187ee None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:58.038285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:58.038768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.039053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.039331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.049110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:58.049818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c13ef-ecaa-44ea-812a-0fb97437d528 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.050109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c13ef-ecaa-44ea-812a-0fb97437d528 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.050389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c13ef-ecaa-44ea-812a-0fb97437d528 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.050740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587aa46-1dd9-447e-88ea-15eab7848934 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:58.052182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 642/1298] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:31:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:31:58.058612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7983a-005a-4e14-9ad1-6c0c9751a192 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.058902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7983a-005a-4e14-9ad1-6c0c9751a192 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.059376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7983a-005a-4e14-9ad1-6c0c9751a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.061696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 657/1299] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:31:58.086452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-69b7983a-005a-4e14-9ad1-6c0c9751a192 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:58.087691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-69b7983a-005a-4e14-9ad1-6c0c9751a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:58.096484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 643/1300] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:31:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:31:58.157068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed6be-ce49-4bea-9f48-161760edc1f7 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.157388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed6be-ce49-4bea-9f48-161760edc1f7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.157673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed6be-ce49-4bea-9f48-161760edc1f7 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.159487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 658/1301] 10.222.0.21 () {54 vars in 966 bytes} [Tue Aug 10 03:31:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:58.165238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169e0e-0ee9-400a-8c9f-e42c80241fd9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.165531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169e0e-0ee9-400a-8c9f-e42c80241fd9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.165807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66169e0e-0ee9-400a-8c9f-e42c80241fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.215614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-66169e0e-0ee9-400a-8c9f-e42c80241fd9 None None] MFA Rules not processed for user `412b07d25ead4bcdb8bf64c0bf8726b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:58.217583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-66169e0e-0ee9-400a-8c9f-e42c80241fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:58.286793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 644/1302] 10.222.0.21 () {58 vars in 1064 bytes} [Tue Aug 10 03:31:58 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:58.294646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed6be-ce49-4bea-9f48-161760edc1f7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:58.305619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed6be-ce49-4bea-9f48-161760edc1f7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:58.309202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:58.309839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:58.310119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:58.310421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:58.319713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:58.321410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4421a09-7289-4843-ae47-1054cda1534d service glance] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:58.332165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 659/1303] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:31:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:31:59.150378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a6b7-6a8c-45b9-8955-1bab36cf7630 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:59.150854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a6b7-6a8c-45b9-8955-1bab36cf7630 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:59.151003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a6b7-6a8c-45b9-8955-1bab36cf7630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:59.202883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f0f0a6b7-6a8c-45b9-8955-1bab36cf7630 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:59.204077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f0f0a6b7-6a8c-45b9-8955-1bab36cf7630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:59.271226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 645/1304] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:31:59 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:59.315443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de671-3a4b-4f45-a49c-3533d726de12 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:59.315959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de671-3a4b-4f45-a49c-3533d726de12 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:59.316069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de671-3a4b-4f45-a49c-3533d726de12 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:59.317786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 660/1305] 10.222.0.21 () {54 vars in 942 bytes} [Tue Aug 10 03:31:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:31:59.324705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d33e0-3964-4f94-98b3-1702322aa9c3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:59.325001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d33e0-3964-4f94-98b3-1702322aa9c3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:59.325460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d33e0-3964-4f94-98b3-1702322aa9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:59.375829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d34d33e0-3964-4f94-98b3-1702322aa9c3 None None] MFA Rules not processed for user `90dad318c8b1444795b9ea36a595d70e`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:31:59.377009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d34d33e0-3964-4f94-98b3-1702322aa9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:31:59.453488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 646/1306] 10.222.0.21 () {58 vars in 1040 bytes} [Tue Aug 10 03:31:59 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:31:59.463454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072de671-3a4b-4f45-a49c-3533d726de12 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:31:59.477407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072de671-3a4b-4f45-a49c-3533d726de12 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:31:59.483130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:31:59.483800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:31:59.484080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:31:59.484389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:31:59.493605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:31:59.495510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8635a1-6cde-4f86-91f3-fcfbcc90544d service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:31:59.505603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 661/1307] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:31:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:32:00.478447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611335-739c-4d23-8ccb-38ae1b8e13a8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:00.479002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611335-739c-4d23-8ccb-38ae1b8e13a8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:00.479718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3611335-739c-4d23-8ccb-38ae1b8e13a8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:00.482528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 647/1308] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:00.488705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b11c2-4820-4178-a9b3-c32a4447bf71 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:00.489630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b11c2-4820-4178-a9b3-c32a4447bf71 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:00.490144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b11c2-4820-4178-a9b3-c32a4447bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:00.511330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-928b11c2-4820-4178-a9b3-c32a4447bf71 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:00.512992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-928b11c2-4820-4178-a9b3-c32a4447bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:00.528247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 662/1309] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:00.569588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3611335-739c-4d23-8ccb-38ae1b8e13a8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:00.591238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3611335-739c-4d23-8ccb-38ae1b8e13a8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:00.596957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:00.597614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:00.597899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:00.598178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:00.609382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:00.611117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3fab3-8ef2-4973-bb25-3aa5de107205 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:00.624181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 648/1310] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:03.082065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d3b9-7111-43af-92e8-2f82e814a5cc None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:03.082605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d3b9-7111-43af-92e8-2f82e814a5cc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:03.082605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d3b9-7111-43af-92e8-2f82e814a5cc None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:03.085766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 663/1311] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:03.092284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d973d-318c-406f-9215-11f181ce2487 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:03.092755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d973d-318c-406f-9215-11f181ce2487 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:03.092955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d973d-318c-406f-9215-11f181ce2487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:03.111999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-402d973d-318c-406f-9215-11f181ce2487 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:03.130867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-402d973d-318c-406f-9215-11f181ce2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:03.130867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 649/1312] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:03.170422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d3b9-7111-43af-92e8-2f82e814a5cc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:03.184767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d3b9-7111-43af-92e8-2f82e814a5cc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:03.194731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:03.194731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:03.194731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:03.194731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:03.204066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:03.205713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca6b006-4e8f-4fbd-b17a-5f207eeda240 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:03.215860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 664/1313] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:18.235016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87588b-10da-4e94-bc9b-12e9bf2d88b5 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:18.235649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87588b-10da-4e94-bc9b-12e9bf2d88b5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:18.235649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87588b-10da-4e94-bc9b-12e9bf2d88b5 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:18.237413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 650/1314] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:18.243460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e311-b422-46d4-8a83-3ca39884ebcc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:18.249512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e311-b422-46d4-8a83-3ca39884ebcc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:18.249512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0e311-b422-46d4-8a83-3ca39884ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:18.266599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fbb0e311-b422-46d4-8a83-3ca39884ebcc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:18.267808 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fbb0e311-b422-46d4-8a83-3ca39884ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:18.276000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 665/1315] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:18.300648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87588b-10da-4e94-bc9b-12e9bf2d88b5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:18.313917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87588b-10da-4e94-bc9b-12e9bf2d88b5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:18.318466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:18.319122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:18.319408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:18.319686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:18.320504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:18.322344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf0e7-699b-4778-ad9e-fb416483418b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:18.336859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 651/1316] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:32:18 2021] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:32:20.446440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964896-98b5-4114-ab4c-e63b0bf1890b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:20.447030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964896-98b5-4114-ab4c-e63b0bf1890b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:20.447030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964896-98b5-4114-ab4c-e63b0bf1890b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:20.448818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 666/1317] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:20.454852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:20.455632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:20.455916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:20.474435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:20.475623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:20.484144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 652/1318] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:20.509404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77964896-98b5-4114-ab4c-e63b0bf1890b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:20.522228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77964896-98b5-4114-ab4c-e63b0bf1890b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:20.526704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:20.527594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:20.527871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:20.528139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] PATH_INFO: `/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:20.538656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f59dbb9080b4899bcbe1c705b7dee08)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:20.540760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:20.542502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 667/1319] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:20 2021] GET /identity/v3/projects/1f59dbb9080b4899bcbe1c705b7dee08 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:32:20.549867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:20.559426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9fab0-b7c5-4f0e-9506-1b9dbc86cf21 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:20.565115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:20.565763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:20.566051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:20.566331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:20.567250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] RBAC: Adding query filter params (scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:20.567562 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:20.569461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03aa8f7-b58c-4523-8c7d-941def017df8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:20.576217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 653/1320] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:20 2021] GET /identity/v3/role_assignments?scope.project.id=1f59dbb9080b4899bcbe1c705b7dee08 => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:20.582571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:20.592235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159d9a8-0ce3-4415-bef1-f26f28f3b621 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:20.596844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:20.597701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:20.597984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:20.598260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] PATH_INFO: `/v3/users/f9d631f2582444938d69176a5ff8b61d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:20.612709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] RBAC: Authorizing `identity:get_user(user_id=f9d631f2582444938d69176a5ff8b61d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:20.614749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9add7-b0ee-4869-b9f9-fdc7210ec25d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:20.616427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 668/1321] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:20 2021] GET /identity/v3/users/f9d631f2582444938d69176a5ff8b61d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:22.836191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f210-32ba-41a4-9f52-a1ea896006bc None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:22.836795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f210-32ba-41a4-9f52-a1ea896006bc None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:22.836795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9f210-32ba-41a4-9f52-a1ea896006bc None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:22.838544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 654/1322] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:32:22.845235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:22.845731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:22.845822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:22.863349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:22.864632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:22.872913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 669/1323] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:22.898143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f210-32ba-41a4-9f52-a1ea896006bc None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:22.912258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9f210-32ba-41a4-9f52-a1ea896006bc None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:22.917018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:22.917873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:22.918152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:22.918426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] PATH_INFO: `/v3/projects/466137c38f41488b86ca3076c0fd289a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:22.929956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] RBAC: Authorizing `identity:get_project(project_id=466137c38f41488b86ca3076c0fd289a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:22.932415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:22.934477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 655/1324] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:22 2021] GET /identity/v3/projects/466137c38f41488b86ca3076c0fd289a => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:22.941735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:22.951422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ecea7-84a9-49ee-8cac-115218fb05ae None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:22.956035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:22.956704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:22.956990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:22.957307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:22.958072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] RBAC: Adding query filter params (scope.project.id=466137c38f41488b86ca3076c0fd289a) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:22.958381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:22.960255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c9c3d-97cd-4899-9b36-b10bf06b8425 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:22.966925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 670/1325] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:22 2021] GET /identity/v3/role_assignments?scope.project.id=466137c38f41488b86ca3076c0fd289a => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:22.973392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:22.983445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f9503-a656-4f8d-a37c-3b8f44fd4af7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:22.987985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:22.988905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:22.989182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:22.989457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:23.004619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:23.006568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec21be-6a4e-4ae1-a652-76de8b37f8dc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:23.008286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 656/1326] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:22 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:25.181629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2ae78-972d-44f4-a5f6-d50634aae37b None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.182211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2ae78-972d-44f4-a5f6-d50634aae37b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.182326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2ae78-972d-44f4-a5f6-d50634aae37b None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.184036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 671/1327] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:25.190935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.191425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.191530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.208957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:25.210170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:25.218688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 657/1328] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:25.243986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2ae78-972d-44f4-a5f6-d50634aae37b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:25.257050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2ae78-972d-44f4-a5f6-d50634aae37b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:25.261457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:25.262335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.262623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.262920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] PATH_INFO: `/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.274887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] RBAC: Authorizing `identity:get_project(project_id=5bdcf143b1194ee4b2182082c9e5dcce)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:25.276999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:25.279276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 672/1329] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:25 2021] GET /identity/v3/projects/5bdcf143b1194ee4b2182082c9e5dcce => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:25.285928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:25.295800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b336b-7a95-44b6-ba09-0b996cbbd122 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:25.300331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:25.300973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.301253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.301527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.302283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] RBAC: Adding query filter params (scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:25.302586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:25.304429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:25.311193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 658/1330] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:25 2021] GET /identity/v3/role_assignments?scope.project.id=5bdcf143b1194ee4b2182082c9e5dcce => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:32:25.318107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:25.328393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9d239-e695-4985-9318-351ec1542a7e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:25.333186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:25.334065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.334352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.334639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.335865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:25.337728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25865b-1869-45f1-b8b8-d5d1b23a9fe2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:25.339397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 673/1331] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:25 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:25.346329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:25.356180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8c7e-41f1-4dab-a5ef-8711fce50197 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:25.361960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:25.366031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:25.366031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:25.366031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] PATH_INFO: `/v3/users/333ab62b8878407e9fde1f4549e5372f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:25.366031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] RBAC: Authorizing `identity:get_user(user_id=333ab62b8878407e9fde1f4549e5372f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:25.366958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba881aac-c6bc-4862-80f6-b7d9c202e522 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:25.368698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 659/1332] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:25 2021] GET /identity/v3/users/333ab62b8878407e9fde1f4549e5372f => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:27.600669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ed4-dec4-4781-90c1-833216d2fec1 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:27.601282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ed4-dec4-4781-90c1-833216d2fec1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:27.601282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ed4-dec4-4781-90c1-833216d2fec1 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:27.603487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 674/1333] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:27.611433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:27.611995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:27.612092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:27.631718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:27.633485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:27.647888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 660/1334] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:27.674059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918ed4-dec4-4781-90c1-833216d2fec1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:27.687176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918ed4-dec4-4781-90c1-833216d2fec1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:27.692077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:27.693032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:27.693329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:27.693617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] PATH_INFO: `/v3/projects/647963c20a404d129c9e30cc363e25e1` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:27.705335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=647963c20a404d129c9e30cc363e25e1)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:27.707389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:27.709312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 675/1335] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:27 2021] GET /identity/v3/projects/647963c20a404d129c9e30cc363e25e1 => generated 361 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:27.716037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:27.725473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726943e6-2716-4d73-b6b1-0b9d62d7eac0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:27.730011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:27.730649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:27.730928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:27.731202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:27.732117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] RBAC: Adding query filter params (scope.project.id=647963c20a404d129c9e30cc363e25e1) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:27.732457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:27.737675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a431a9-bace-43b1-87ee-c7aba87ba20c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:27.741333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 661/1336] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:27 2021] GET /identity/v3/role_assignments?scope.project.id=647963c20a404d129c9e30cc363e25e1 => generated 526 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:27.748835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:27.759015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36688ba-483d-40ed-b72e-493e0330b6a9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:27.764377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:27.765257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:27.765595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:27.765878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] PATH_INFO: `/v3/users/1e3eb97736ce404bbf54db1ecbfd272f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:27.780485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=1e3eb97736ce404bbf54db1ecbfd272f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:27.782695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c2afb-d1a7-4cb0-96e8-4be48c942cc1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:27.784414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 676/1337] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:27 2021] GET /identity/v3/users/1e3eb97736ce404bbf54db1ecbfd272f => generated 311 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:29.960925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f489a-ebb9-49b8-a179-a9652b9ecbbf None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:29.961524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f489a-ebb9-49b8-a179-a9652b9ecbbf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:29.961524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f489a-ebb9-49b8-a179-a9652b9ecbbf None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:29.963307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 662/1338] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:29.969994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:29.970498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:29.970603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:29.989331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:29.990554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:29.998843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 677/1339] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:30.022493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f489a-ebb9-49b8-a179-a9652b9ecbbf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:30.036309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f489a-ebb9-49b8-a179-a9652b9ecbbf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:30.040728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:30.041567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:30.041849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:30.042123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] PATH_INFO: `/v3/projects/64cae0bfab52452b930e27b4937b2ea2` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:30.053261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] RBAC: Authorizing `identity:get_project(project_id=64cae0bfab52452b930e27b4937b2ea2)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:30.055291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:30.057029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 663/1340] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:30 2021] GET /identity/v3/projects/64cae0bfab52452b930e27b4937b2ea2 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:30.063885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:30.073083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847e04-fc86-48b8-9359-3c6170f63d5d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:30.078564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:30.079211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:30.079524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:30.079824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:30.080621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] RBAC: Adding query filter params (scope.project.id=64cae0bfab52452b930e27b4937b2ea2) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:30.080925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:30.082817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:30.089246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 678/1341] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:30 2021] GET /identity/v3/role_assignments?scope.project.id=64cae0bfab52452b930e27b4937b2ea2 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:30.096291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:30.106477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959fd8f-1080-42a1-b4e9-189b221b1afd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:30.111474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:30.112413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:30.112706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:30.112991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] PATH_INFO: `/v3/users/d98de69f0a9f4f9e97245e70f70e8628` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:30.128742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] RBAC: Authorizing `identity:get_user(user_id=d98de69f0a9f4f9e97245e70f70e8628)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:30.131066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cca1c8-d462-467b-80fe-dddbb796b614 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:30.132930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 664/1342] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:30 2021] GET /identity/v3/users/d98de69f0a9f4f9e97245e70f70e8628 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:30.142164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:30.152384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2e51-93b0-4f15-a3bc-e1eae87ef4f7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:30.157800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:30.158664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:30.158943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:30.159216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] PATH_INFO: `/v3/users/34600bad60824d0d8c79fd80c2f9bfae` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:30.174070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] RBAC: Authorizing `identity:get_user(user_id=34600bad60824d0d8c79fd80c2f9bfae)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:30.176273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d135a5e-6fa2-4cc0-b14a-b28c7c625c6d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:30.178021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 679/1343] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:30 2021] GET /identity/v3/users/34600bad60824d0d8c79fd80c2f9bfae => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:32.399717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8aba-e24e-43ae-b5a0-b89711a27ab3 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.400274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8aba-e24e-43ae-b5a0-b89711a27ab3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.400274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af8aba-e24e-43ae-b5a0-b89711a27ab3 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.402104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 665/1344] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:32.408541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.409019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.409123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.427125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:32.428355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:32.436851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 680/1345] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:32.460930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af8aba-e24e-43ae-b5a0-b89711a27ab3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:32.473972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af8aba-e24e-43ae-b5a0-b89711a27ab3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:32.478423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:32.479287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.479582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.479860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] PATH_INFO: `/v3/projects/a2f94dbee7074a698ede330affc5cf71` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.491049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a2f94dbee7074a698ede330affc5cf71)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:32.493168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:32.495169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 666/1346] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:32 2021] GET /identity/v3/projects/a2f94dbee7074a698ede330affc5cf71 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:32.502417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:32.511769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b38b7-0ea1-4ff0-8f39-abaacb5ddf76 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:32.516383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:32.517022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.517306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.517583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.518341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] RBAC: Adding query filter params (scope.project.id=a2f94dbee7074a698ede330affc5cf71) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:32.518648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:32.520495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:32.527132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 681/1347] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:32 2021] GET /identity/v3/role_assignments?scope.project.id=a2f94dbee7074a698ede330affc5cf71 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:32:32.533803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:32.543487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188941e-770c-47a7-b29f-e8e94148a9b5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:32.548838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:32.550399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.550399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.550399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] PATH_INFO: `/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.564872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] RBAC: Authorizing `identity:get_user(user_id=8acc6ba08ebc4ff5b92ab4ee700be067)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:32.567062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e449c-4fba-4d5b-8310-d045ed2c2012 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:32.568856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 667/1348] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:32 2021] GET /identity/v3/users/8acc6ba08ebc4ff5b92ab4ee700be067 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:32.577255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:32.589298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d0274-bb0a-44f1-82be-acc0e6c995cc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:32.594174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:32.595065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:32.595413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:32.595695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:32.596900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:32.598699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46710c10-7471-4f6c-abb9-79b7dd47ba1b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:32.600470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 682/1349] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:32 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:34.835326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6276d-2426-4d38-a5c8-7ff3cbb88d19 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:34.835997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6276d-2426-4d38-a5c8-7ff3cbb88d19 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:34.835997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6276d-2426-4d38-a5c8-7ff3cbb88d19 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:34.837702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 668/1350] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:34.844433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:34.844923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:34.845032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:34.862866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:34.864122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:34.872731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 683/1351] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:34.897557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6276d-2426-4d38-a5c8-7ff3cbb88d19 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:34.911889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6276d-2426-4d38-a5c8-7ff3cbb88d19 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:34.916325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:34.917180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:34.917460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:34.917729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] PATH_INFO: `/v3/projects/d847766cb8f7495b8c5c2a2d48910f07` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:34.918954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] RBAC: Authorizing `identity:get_project(project_id=d847766cb8f7495b8c5c2a2d48910f07)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:34.920777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:34.922481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 669/1352] 10.222.0.21 () {56 vars in 1208 bytes} [Tue Aug 10 03:32:34 2021] GET /identity/v3/projects/d847766cb8f7495b8c5c2a2d48910f07 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:34.929601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:34.939568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f38c-a868-4527-8e8c-b4d3e7e8e4b1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:34.945057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:34.945702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:34.946012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:34.946287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:34.947067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] RBAC: Adding query filter params (scope.project.id=d847766cb8f7495b8c5c2a2d48910f07) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:32:34.947358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:34.949305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d1c72-ff9d-4500-a201-e3badd6fc0c2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:34.955839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 684/1353] 10.222.0.21 () {56 vars in 1232 bytes} [Tue Aug 10 03:32:34 2021] GET /identity/v3/role_assignments?scope.project.id=d847766cb8f7495b8c5c2a2d48910f07 => generated 879 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:34.962663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:34.972865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5304c5-567d-4e98-b352-213fbe2d0c65 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:34.977252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:34.978112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:34.978397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:34.978682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] PATH_INFO: `/v3/users/f29509a114484baab53625cc3aa60565` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:34.979865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] RBAC: Authorizing `identity:get_user(user_id=f29509a114484baab53625cc3aa60565)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:34.981702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f7ca-3448-4a59-8590-9574de694d87 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:34.983313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 670/1354] 10.222.0.21 () {56 vars in 1199 bytes} [Tue Aug 10 03:32:34 2021] GET /identity/v3/users/f29509a114484baab53625cc3aa60565 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:32:40.401352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756644-e899-4c24-b379-1a42b3c60e6d None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:40.402015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756644-e899-4c24-b379-1a42b3c60e6d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:40.402015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756644-e899-4c24-b379-1a42b3c60e6d None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:40.404285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 685/1355] 10.222.0.21 () {54 vars in 918 bytes} [Tue Aug 10 03:32:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:40.410450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be36bf-aad7-4602-add0-c8d23178cf4c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:40.410972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be36bf-aad7-4602-add0-c8d23178cf4c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:40.410972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be36bf-aad7-4602-add0-c8d23178cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:40.429467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-47be36bf-aad7-4602-add0-c8d23178cf4c None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:40.430664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-47be36bf-aad7-4602-add0-c8d23178cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:40.439035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 671/1356] 10.222.0.21 () {58 vars in 1016 bytes} [Tue Aug 10 03:32:40 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:40.455805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189462a7-b946-464c-bd3d-63d37e678117 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:40.456088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189462a7-b946-464c-bd3d-63d37e678117 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:40.456397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189462a7-b946-464c-bd3d-63d37e678117 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:40.458162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 686/1357] 10.222.0.21 () {54 vars in 918 bytes} [Tue Aug 10 03:32:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:40.464191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b23b4-426f-4416-a7db-b90b731b52dd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:40.464508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b23b4-426f-4416-a7db-b90b731b52dd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:40.464795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b23b4-426f-4416-a7db-b90b731b52dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:40.483661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e70b23b4-426f-4416-a7db-b90b731b52dd None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:40.485006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e70b23b4-426f-4416-a7db-b90b731b52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:40.494727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 672/1358] 10.222.0.21 () {58 vars in 1016 bytes} [Tue Aug 10 03:32:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:43.337678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd78bb-a0b8-41b2-ae80-d7205567f14d None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:43.338243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd78bb-a0b8-41b2-ae80-d7205567f14d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:43.338243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd78bb-a0b8-41b2-ae80-d7205567f14d None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:43.339986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 687/1359] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:43.347364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060f967-bd6c-433e-a4eb-5c36aa307555 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:43.347860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060f967-bd6c-433e-a4eb-5c36aa307555 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:43.348362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060f967-bd6c-433e-a4eb-5c36aa307555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:43.368592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7060f967-bd6c-433e-a4eb-5c36aa307555 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:43.369979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7060f967-bd6c-433e-a4eb-5c36aa307555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:43.377872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 673/1360] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:43.421559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd78bb-a0b8-41b2-ae80-d7205567f14d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:43.435514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd78bb-a0b8-41b2-ae80-d7205567f14d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:43.441107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:43.441746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:43.442032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:43.442303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:43.451511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:43.453127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61146d-fb1e-47e0-bb38-42e6248e47cc service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:43.462652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 688/1361] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:44.899716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a122-2464-4646-9ef2-e77b0df0c915 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:44.900317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a122-2464-4646-9ef2-e77b0df0c915 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:44.900317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a122-2464-4646-9ef2-e77b0df0c915 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:44.902105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 674/1362] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:44.909540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea625e-57a9-453e-9410-72aa825bac00 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:44.910108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea625e-57a9-453e-9410-72aa825bac00 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:44.910360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea625e-57a9-453e-9410-72aa825bac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:44.932558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-40ea625e-57a9-453e-9410-72aa825bac00 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:44.933776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-40ea625e-57a9-453e-9410-72aa825bac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:44.941848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 689/1363] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:45.096790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a122-2464-4646-9ef2-e77b0df0c915 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:45.111895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a122-2464-4646-9ef2-e77b0df0c915 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:45.117200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:45.117848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:45.118133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:45.118410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:45.128257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:45.129865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47105e7b-60b3-438c-af38-d90c919902d6 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:45.140602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 675/1364] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:46.547144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05c1-8aef-4b21-b388-fdda193ee1d1 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:46.547751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05c1-8aef-4b21-b388-fdda193ee1d1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:46.547751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05c1-8aef-4b21-b388-fdda193ee1d1 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:46.549568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 690/1365] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:46.555328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253e485-e10b-4c08-9a35-92d4345245c3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:46.555835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253e485-e10b-4c08-9a35-92d4345245c3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:46.555940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253e485-e10b-4c08-9a35-92d4345245c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:46.573572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c253e485-e10b-4c08-9a35-92d4345245c3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:46.575319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c253e485-e10b-4c08-9a35-92d4345245c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:46.583375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 676/1366] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:46.735919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c05c1-8aef-4b21-b388-fdda193ee1d1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:46.750906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c05c1-8aef-4b21-b388-fdda193ee1d1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:46.756471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:46.757105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:46.757389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:46.757667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:46.766322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:46.767988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937ebbd-ce71-4761-97bb-aad4a26d543a service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:46.777259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 691/1367] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:48.178912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ee68-2c1a-4dfc-b964-5ed7d0bb87f8 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:48.179543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ee68-2c1a-4dfc-b964-5ed7d0bb87f8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:48.179543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ee68-2c1a-4dfc-b964-5ed7d0bb87f8 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:48.181295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 677/1368] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:48.188613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a12f-a055-4a76-818f-ca849b51de2f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:48.189080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a12f-a055-4a76-818f-ca849b51de2f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:48.189193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a12f-a055-4a76-818f-ca849b51de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:48.207626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ef89a12f-a055-4a76-818f-ca849b51de2f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:48.208861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ef89a12f-a055-4a76-818f-ca849b51de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:48.216878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 692/1369] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:48.372933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3ee68-2c1a-4dfc-b964-5ed7d0bb87f8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:48.387390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3ee68-2c1a-4dfc-b964-5ed7d0bb87f8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:48.393478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:48.394136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:48.394422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:48.394703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:48.404233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:48.406074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b46d6-325e-42ed-8330-c4160bfc12bb service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:48.416746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 678/1370] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:49.818807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bae989-3e25-4bac-ad90-430c4572f091 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:49.819400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bae989-3e25-4bac-ad90-430c4572f091 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:49.819400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bae989-3e25-4bac-ad90-430c4572f091 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:49.821208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 693/1371] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:49.827351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcfee-1d17-452d-bd90-88322377da10 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:49.827781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcfee-1d17-452d-bd90-88322377da10 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:49.827916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcfee-1d17-452d-bd90-88322377da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:49.845343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-dc4fcfee-1d17-452d-bd90-88322377da10 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:49.846534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-dc4fcfee-1d17-452d-bd90-88322377da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:49.854375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 679/1372] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:50.009780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bae989-3e25-4bac-ad90-430c4572f091 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:50.024862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bae989-3e25-4bac-ad90-430c4572f091 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:50.030493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:50.031434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:50.031720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:50.031988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:50.040759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:50.042334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d113bf-80eb-451b-ab01-807892543f50 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:50.052243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 694/1373] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:51.535525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f352-c135-466c-96a1-ca6e1e4a1cc6 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:51.536136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f352-c135-466c-96a1-ca6e1e4a1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:51.536136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f352-c135-466c-96a1-ca6e1e4a1cc6 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:51.538048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 680/1374] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:51.544304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9530-8ae8-4f11-8260-d6c24b5eaa99 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:51.544795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9530-8ae8-4f11-8260-d6c24b5eaa99 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:51.545010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e9530-8ae8-4f11-8260-d6c24b5eaa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:51.562934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ec0e9530-8ae8-4f11-8260-d6c24b5eaa99 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:51.564266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ec0e9530-8ae8-4f11-8260-d6c24b5eaa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:51.572832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 695/1375] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:51.735966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f352-c135-466c-96a1-ca6e1e4a1cc6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:51.751437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f352-c135-466c-96a1-ca6e1e4a1cc6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:51.757185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:51.757837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:51.758118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:51.758392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:51.767607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:51.769426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08080e0-c223-4727-aab1-e12198046da0 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:51.780088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 681/1376] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:53.209320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869ab8-39f9-453e-815d-8c33bc22aa72 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:53.209904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869ab8-39f9-453e-815d-8c33bc22aa72 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:53.209904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869ab8-39f9-453e-815d-8c33bc22aa72 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:53.211678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 696/1377] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:53.218446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-ce47-4b7f-a177-c2a8d6e490eb None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:53.218963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-ce47-4b7f-a177-c2a8d6e490eb None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:53.219061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-ce47-4b7f-a177-c2a8d6e490eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:53.236914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-59262b72-ce47-4b7f-a177-c2a8d6e490eb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:53.238187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-59262b72-ce47-4b7f-a177-c2a8d6e490eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:53.247725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 682/1378] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:53.402207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869ab8-39f9-453e-815d-8c33bc22aa72 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:53.416660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869ab8-39f9-453e-815d-8c33bc22aa72 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:53.422219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:53.422868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:53.423158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:53.423442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:53.432078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:53.433713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3773b-d9d4-4732-8b76-a706f9ca43b8 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:53.443998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 697/1379] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:54.874009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072594c-b7db-46ed-9605-5424b0681394 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:54.874555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072594c-b7db-46ed-9605-5424b0681394 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:54.874555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072594c-b7db-46ed-9605-5424b0681394 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:54.876470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 683/1380] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:54.885930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65a88-51ae-447b-993e-3c17a3652779 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:54.886513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65a88-51ae-447b-993e-3c17a3652779 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:54.886785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65a88-51ae-447b-993e-3c17a3652779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:54.911215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-faa65a88-51ae-447b-993e-3c17a3652779 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:54.913445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-faa65a88-51ae-447b-993e-3c17a3652779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:54.921208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 698/1381] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:55.076480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072594c-b7db-46ed-9605-5424b0681394 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:55.093277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072594c-b7db-46ed-9605-5424b0681394 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:55.098762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:55.099420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:55.099707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:55.099988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:55.109395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:55.111001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b07b5c-b3e8-4fb5-a410-d694b9874839 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:55.121701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 684/1382] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:56.620283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a1ca-dc59-4301-b9c3-8882d2ba13de None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:56.620852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a1ca-dc59-4301-b9c3-8882d2ba13de None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:56.620852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993a1ca-dc59-4301-b9c3-8882d2ba13de None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:56.623143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 699/1383] 10.222.0.21 () {54 vars in 911 bytes} [Tue Aug 10 03:32:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:56.628801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e05d-d349-4abb-99fc-104d640ae5ea None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:56.629251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e05d-d349-4abb-99fc-104d640ae5ea None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:56.629392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e05d-d349-4abb-99fc-104d640ae5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:56.648380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8b29e05d-d349-4abb-99fc-104d640ae5ea None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:56.649594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8b29e05d-d349-4abb-99fc-104d640ae5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:56.657457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 685/1384] 10.222.0.21 () {58 vars in 1009 bytes} [Tue Aug 10 03:32:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:56.811512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993a1ca-dc59-4301-b9c3-8882d2ba13de None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:56.825710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993a1ca-dc59-4301-b9c3-8882d2ba13de None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:56.831050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:56.831687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:56.831973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:56.832284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:56.840724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:56.842323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e57e-81fa-4a6d-b23c-2318d47d8341 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:56.851765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 700/1385] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:32:58.957211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e22-3a0c-4a74-89fd-45c52b506c4d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:58.958038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e22-3a0c-4a74-89fd-45c52b506c4d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:58.958038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24e22-3a0c-4a74-89fd-45c52b506c4d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:58.959605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 686/1386] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:32:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:32:58.966164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b0e4-d515-4801-a7c8-466dc9bfc68e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:58.966581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b0e4-d515-4801-a7c8-466dc9bfc68e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:58.966720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117b0e4-d515-4801-a7c8-466dc9bfc68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:58.985099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6117b0e4-d515-4801-a7c8-466dc9bfc68e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:32:58.986327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6117b0e4-d515-4801-a7c8-466dc9bfc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:32:58.997298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 701/1387] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:32:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:32:59.038274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24e22-3a0c-4a74-89fd-45c52b506c4d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:32:59.049998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24e22-3a0c-4a74-89fd-45c52b506c4d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:32:59.053791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:32:59.054486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:32:59.054768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:32:59.055040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:32:59.064969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:32:59.066461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43133e98-07b6-4142-a063-e9f7be64e337 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:32:59.080297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 687/1388] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:32:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:01.372778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261f8f-be2a-44e0-9487-1ddff2960509 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:01.373324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261f8f-be2a-44e0-9487-1ddff2960509 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:01.373324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261f8f-be2a-44e0-9487-1ddff2960509 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:01.374967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 702/1389] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:01.381382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3271b8-ef27-4545-9c0f-823695ebd75d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:01.381869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3271b8-ef27-4545-9c0f-823695ebd75d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:01.382039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3271b8-ef27-4545-9c0f-823695ebd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:01.401241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8d3271b8-ef27-4545-9c0f-823695ebd75d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:01.402496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8d3271b8-ef27-4545-9c0f-823695ebd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:01.410568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 688/1390] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:33:01.452779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261f8f-be2a-44e0-9487-1ddff2960509 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:01.464065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261f8f-be2a-44e0-9487-1ddff2960509 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:01.467839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:01.468547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:01.468836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:01.471240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:01.478463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:01.479907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89a6c-3173-4a23-b935-709c3c8b2f11 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:01.490473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 703/1391] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:04.079093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd7a-c109-4384-a6ab-af2dd57afc73 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:04.079640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd7a-c109-4384-a6ab-af2dd57afc73 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:04.079640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7bd7a-c109-4384-a6ab-af2dd57afc73 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:04.081424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 689/1392] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:04.088035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca30f0-5557-4804-a6d3-9af08b731c59 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:04.088554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca30f0-5557-4804-a6d3-9af08b731c59 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:04.089040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca30f0-5557-4804-a6d3-9af08b731c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:04.107009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b6ca30f0-5557-4804-a6d3-9af08b731c59 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:04.108318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b6ca30f0-5557-4804-a6d3-9af08b731c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:04.116274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 704/1393] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:04.156983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bd7a-c109-4384-a6ab-af2dd57afc73 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:04.168076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7bd7a-c109-4384-a6ab-af2dd57afc73 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:04.171552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:04.172181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:04.172501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:04.172777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:04.181431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:04.182845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059e46-0316-4013-adce-843815dcaec0 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:04.192613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 690/1394] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:06.627174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f27c5-473e-4323-8f60-aff3780513b4 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:06.628227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f27c5-473e-4323-8f60-aff3780513b4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:06.628227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f27c5-473e-4323-8f60-aff3780513b4 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:06.629575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 705/1395] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:06.635587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224189-e1b5-4916-ac6d-bbe4041c0be6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:06.636097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224189-e1b5-4916-ac6d-bbe4041c0be6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:06.636241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224189-e1b5-4916-ac6d-bbe4041c0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:06.654453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f2224189-e1b5-4916-ac6d-bbe4041c0be6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:06.655876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f2224189-e1b5-4916-ac6d-bbe4041c0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:06.663642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 691/1396] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:06.703276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f27c5-473e-4323-8f60-aff3780513b4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:06.714106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f27c5-473e-4323-8f60-aff3780513b4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:06.717856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:06.718488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:06.718774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:06.719057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:06.730158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:06.732219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72554-3693-4de8-87aa-2c7d1f3b1e74 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:06.741790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 706/1397] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:08.956506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509449-42d0-4502-aa82-a4e94051fdef None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:08.957102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509449-42d0-4502-aa82-a4e94051fdef None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:08.957203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509449-42d0-4502-aa82-a4e94051fdef None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:08.958951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 692/1398] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:08.966043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec8e-61a1-4465-bb71-97abc5238230 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:08.966525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec8e-61a1-4465-bb71-97abc5238230 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:08.966656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ec8e-61a1-4465-bb71-97abc5238230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:08.984674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-10b9ec8e-61a1-4465-bb71-97abc5238230 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:08.985891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-10b9ec8e-61a1-4465-bb71-97abc5238230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:08.994094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 707/1399] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:09.033816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509449-42d0-4502-aa82-a4e94051fdef None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:09.044782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509449-42d0-4502-aa82-a4e94051fdef None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:09.048507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:09.049371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:09.049496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:09.049777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:09.059505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:09.061010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9b51c-7a85-430b-b73d-96055f91d524 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:09.072063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 693/1400] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:11.333566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cfef-77db-4426-98fa-c685b7ffcf2e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:11.334164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cfef-77db-4426-98fa-c685b7ffcf2e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:11.334164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720cfef-77db-4426-98fa-c685b7ffcf2e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:11.335899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 708/1401] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:11.342056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591474-fed2-4ef2-b045-d40752b61ca4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:11.342519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591474-fed2-4ef2-b045-d40752b61ca4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:11.342661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591474-fed2-4ef2-b045-d40752b61ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:11.361356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1a591474-fed2-4ef2-b045-d40752b61ca4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:11.362521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1a591474-fed2-4ef2-b045-d40752b61ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:11.370683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 694/1402] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:11.410774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720cfef-77db-4426-98fa-c685b7ffcf2e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:11.422166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720cfef-77db-4426-98fa-c685b7ffcf2e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:11.425714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:11.426357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:11.426639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:11.426915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:11.436396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:11.437859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cea4cf-7a64-4dfb-b558-2cfc8831de5e service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:11.446913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 709/1403] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:13.657671 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d148-fc71-4357-834e-4110d3a01cfd None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:13.658246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d148-fc71-4357-834e-4110d3a01cfd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:13.658246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220d148-fc71-4357-834e-4110d3a01cfd None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:13.660007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 695/1404] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:13.666244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f981-dc6e-412b-93bc-89d8ff92d045 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:13.666960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f981-dc6e-412b-93bc-89d8ff92d045 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:13.666960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f981-dc6e-412b-93bc-89d8ff92d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:13.685780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a7d3f981-dc6e-412b-93bc-89d8ff92d045 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:13.686994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a7d3f981-dc6e-412b-93bc-89d8ff92d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:13.695381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 710/1405] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:13.733215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d148-fc71-4357-834e-4110d3a01cfd None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:13.743974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220d148-fc71-4357-834e-4110d3a01cfd None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:13.748118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:13.748835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:13.749116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:13.749390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:13.758079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:13.759540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190864-4e0f-4dd6-a5be-eae766dc5d2f service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:13.769266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 696/1406] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:15.967655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bee65-dc72-4e53-baee-52907f9b917d None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:15.968258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bee65-dc72-4e53-baee-52907f9b917d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:15.968258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bee65-dc72-4e53-baee-52907f9b917d None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:15.970016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 711/1407] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:15.976299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0a64-2dc3-4857-9648-b845ddc11441 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:15.976794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0a64-2dc3-4857-9648-b845ddc11441 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:15.976937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0a64-2dc3-4857-9648-b845ddc11441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:15.995332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e46c0a64-2dc3-4857-9648-b845ddc11441 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:15.996614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e46c0a64-2dc3-4857-9648-b845ddc11441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:16.004144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 697/1408] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:16.042438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bee65-dc72-4e53-baee-52907f9b917d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:16.053618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bee65-dc72-4e53-baee-52907f9b917d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:16.057171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:16.057828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:16.058111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:16.058408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:16.067402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:16.068866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990155d5-3b18-4e66-8151-2a5d3a3f9f50 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:16.078803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 712/1409] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:18.245858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390b09-c287-484f-8e60-6796b19911fe None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:18.255775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390b09-c287-484f-8e60-6796b19911fe None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:18.255775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f390b09-c287-484f-8e60-6796b19911fe None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:18.255775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 698/1410] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:18.256095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30bee-dd5b-4fe6-90ee-327bf5cd78dc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:18.256095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30bee-dd5b-4fe6-90ee-327bf5cd78dc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:18.256095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30bee-dd5b-4fe6-90ee-327bf5cd78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:18.274796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ecc30bee-dd5b-4fe6-90ee-327bf5cd78dc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:18.276003 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ecc30bee-dd5b-4fe6-90ee-327bf5cd78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:18.285269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 713/1411] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:18.323313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f390b09-c287-484f-8e60-6796b19911fe None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:18.333974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f390b09-c287-484f-8e60-6796b19911fe None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:18.337545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:18.338087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:18.338370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:18.338642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:18.347753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:18.349228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27faadb-b9c6-4261-9eb1-a00f82945c9c service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:18.359051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 699/1412] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:20.563698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8c12-5922-4e91-bafe-dce239eaeb47 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:20.564280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8c12-5922-4e91-bafe-dce239eaeb47 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:20.564280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8c12-5922-4e91-bafe-dce239eaeb47 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:20.566058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 714/1413] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:20.571997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe592c05-b38a-4497-bca6-4d792e0c7a82 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:20.572499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe592c05-b38a-4497-bca6-4d792e0c7a82 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:20.572611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe592c05-b38a-4497-bca6-4d792e0c7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:20.591300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-fe592c05-b38a-4497-bca6-4d792e0c7a82 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:20.592548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-fe592c05-b38a-4497-bca6-4d792e0c7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:20.602321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 700/1414] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:33:20.642189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b8c12-5922-4e91-bafe-dce239eaeb47 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:20.652776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b8c12-5922-4e91-bafe-dce239eaeb47 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:20.656341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:20.657013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:20.657297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:20.657573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:20.667792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:20.669289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f89246-df9d-4371-865a-81d2969f5334 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:20.679095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 715/1415] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:39.717766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6ca3-3048-4409-ad70-7efb28ada16d None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:39.718375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6ca3-3048-4409-ad70-7efb28ada16d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:39.718375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6ca3-3048-4409-ad70-7efb28ada16d None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:39.720106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 701/1416] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:39.726340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245887-a7da-4be2-9163-4bbb683ebc3e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:39.726873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245887-a7da-4be2-9163-4bbb683ebc3e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:39.726873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245887-a7da-4be2-9163-4bbb683ebc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:39.744905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-06245887-a7da-4be2-9163-4bbb683ebc3e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:39.746636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-06245887-a7da-4be2-9163-4bbb683ebc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:39.754557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 716/1417] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:39.803081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e24c-0e35-4716-b0ce-310b79f0daea None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:39.803377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e24c-0e35-4716-b0ce-310b79f0daea None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:39.803659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3e24c-0e35-4716-b0ce-310b79f0daea None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:39.805466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 702/1418] 10.222.0.21 () {54 vars in 966 bytes} [Tue Aug 10 03:33:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:39.811287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52038-9d14-48df-9e0b-4aae1dee8c93 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:39.811577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52038-9d14-48df-9e0b-4aae1dee8c93 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:39.811857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52038-9d14-48df-9e0b-4aae1dee8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:39.830064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-27f52038-9d14-48df-9e0b-4aae1dee8c93 None None] MFA Rules not processed for user `412b07d25ead4bcdb8bf64c0bf8726b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:39.831278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-27f52038-9d14-48df-9e0b-4aae1dee8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:39.837866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 717/1419] 10.222.0.21 () {58 vars in 1064 bytes} [Tue Aug 10 03:33:39 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:39.845652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3e24c-0e35-4716-b0ce-310b79f0daea None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:39.856275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3e24c-0e35-4716-b0ce-310b79f0daea None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:39.859773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:39.860694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:39.860971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:39.861248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:39.871253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:39.872752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fafcd-765f-41f2-a9ae-8636916687b3 service glance] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:39.881764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 703/1420] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:42.234723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b615a-793f-4859-9590-5b157fc9479e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:42.235279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b615a-793f-4859-9590-5b157fc9479e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:42.235279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b615a-793f-4859-9590-5b157fc9479e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:42.237086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 718/1421] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:42.243182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a34765-0de4-46fb-b7a2-1a6e4616624c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:42.243607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a34765-0de4-46fb-b7a2-1a6e4616624c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:42.243748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a34765-0de4-46fb-b7a2-1a6e4616624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:42.261786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-12a34765-0de4-46fb-b7a2-1a6e4616624c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:42.263059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-12a34765-0de4-46fb-b7a2-1a6e4616624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:42.271090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 704/1422] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:42.296030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b615a-793f-4859-9590-5b157fc9479e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:42.309079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b615a-793f-4859-9590-5b157fc9479e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:42.313833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:42.314526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:42.314809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:42.315135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:42.315899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:42.317888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9029819-5a19-4bb6-b542-9560690ca818 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:42.340821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 719/1423] 10.222.0.21 () {56 vars in 1109 bytes} [Tue Aug 10 03:33:42 2021] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:33:44.549700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96cde-36d9-44d4-9198-9428761891ef None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:44.550270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96cde-36d9-44d4-9198-9428761891ef None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:44.550270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96cde-36d9-44d4-9198-9428761891ef None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:44.552106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 705/1424] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:44.558647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9431-cfeb-4a11-8966-e7b27c5a4c95 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:44.559084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9431-cfeb-4a11-8966-e7b27c5a4c95 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:44.559194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9431-cfeb-4a11-8966-e7b27c5a4c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:44.580450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-809a9431-cfeb-4a11-8966-e7b27c5a4c95 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:44.581686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-809a9431-cfeb-4a11-8966-e7b27c5a4c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:44.589529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 720/1425] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:44.634470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96cde-36d9-44d4-9198-9428761891ef None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:44.648808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96cde-36d9-44d4-9198-9428761891ef None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:44.654328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:44.654971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:44.655415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:44.655697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:44.663723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:44.665354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a2c01-50c2-4a92-96f1-c332fee4c2cf service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:44.675089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 706/1426] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:47.013947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bef80-135e-4679-a120-1b4e7f05bb82 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:47.014512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bef80-135e-4679-a120-1b4e7f05bb82 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:47.014512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bef80-135e-4679-a120-1b4e7f05bb82 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:47.016357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 721/1427] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:47.022824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d76f-7f98-4ac5-9f29-f937da1b5370 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:47.023267 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d76f-7f98-4ac5-9f29-f937da1b5370 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:47.023376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d76f-7f98-4ac5-9f29-f937da1b5370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:47.040865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c454d76f-7f98-4ac5-9f29-f937da1b5370 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:47.042099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c454d76f-7f98-4ac5-9f29-f937da1b5370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:47.049978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 707/1428] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:47.088062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bef80-135e-4679-a120-1b4e7f05bb82 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:47.099646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bef80-135e-4679-a120-1b4e7f05bb82 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:47.103378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:47.104024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:47.104846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:47.105121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:47.114444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:47.115880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5ab5-96e4-4f2e-b385-b0f597ac1426 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:47.126133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 722/1429] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:49.350185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c0c6-a408-4408-8b83-6086292a0db1 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:49.350758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c0c6-a408-4408-8b83-6086292a0db1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:49.350758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c0c6-a408-4408-8b83-6086292a0db1 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:49.352553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 708/1430] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:33:49.359492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f49a5-3711-4add-8ffd-e1cfd120a12a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:49.360007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f49a5-3711-4add-8ffd-e1cfd120a12a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:49.360121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f49a5-3711-4add-8ffd-e1cfd120a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:49.382860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-3b5f49a5-3711-4add-8ffd-e1cfd120a12a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:49.384087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3b5f49a5-3711-4add-8ffd-e1cfd120a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:49.392400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 723/1431] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:49.433385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9c0c6-a408-4408-8b83-6086292a0db1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:49.445817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9c0c6-a408-4408-8b83-6086292a0db1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:49.449813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:49.450476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:49.450761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:49.451062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:49.462780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:49.464800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b828d5-6333-4356-a86d-a82ba7977ddc service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:49.474697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 709/1432] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:51.818564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784fb84-312b-4c2e-a223-90273886e241 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:51.819126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784fb84-312b-4c2e-a223-90273886e241 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:51.819126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784fb84-312b-4c2e-a223-90273886e241 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:51.820999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 724/1433] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:51.827728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a04ae-a3bf-4bda-95ea-470c0e07d180 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:51.828168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a04ae-a3bf-4bda-95ea-470c0e07d180 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:51.828326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a04ae-a3bf-4bda-95ea-470c0e07d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:51.847207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f66a04ae-a3bf-4bda-95ea-470c0e07d180 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:51.848453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f66a04ae-a3bf-4bda-95ea-470c0e07d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:51.856170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 710/1434] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:51.897779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784fb84-312b-4c2e-a223-90273886e241 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:51.909344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784fb84-312b-4c2e-a223-90273886e241 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:51.912876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:51.913523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:51.913804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:51.914076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:51.923004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:51.924537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fcd92-4557-4806-8885-6068e7a3f257 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:51.933651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 725/1435] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:33:54.669734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446b131-008e-4b66-9722-3276eb1516ac None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:54.670321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446b131-008e-4b66-9722-3276eb1516ac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:54.670321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446b131-008e-4b66-9722-3276eb1516ac None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:54.672087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 711/1436] 10.222.0.21 () {54 vars in 926 bytes} [Tue Aug 10 03:33:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:33:54.678144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a5df-2444-4a95-bb73-eba2dcc5065f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:54.678619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a5df-2444-4a95-bb73-eba2dcc5065f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:54.678735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a5df-2444-4a95-bb73-eba2dcc5065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:54.697374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-49c7a5df-2444-4a95-bb73-eba2dcc5065f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:33:54.698673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-49c7a5df-2444-4a95-bb73-eba2dcc5065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:33:54.707284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 726/1437] 10.222.0.21 () {58 vars in 1024 bytes} [Tue Aug 10 03:33:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:33:54.747981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446b131-008e-4b66-9722-3276eb1516ac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:33:54.758567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446b131-008e-4b66-9722-3276eb1516ac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:33:54.762125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:33:54.762759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:33:54.763069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:33:54.763349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:33:54.772365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:33:54.773783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391f205-17e5-42b2-882c-7ede521d21d3 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:33:54.783460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 712/1438] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:33:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:35:43.055144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.055964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.055964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.075227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:35:43.077237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:43.086439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 727/1439] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:35:43.094521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.095271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.095271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.116345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:35:43.117772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:43.126146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 713/1440] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:35:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:35:43.131355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.141493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131b58c-b3c9-421a-be71-1dffd67491a5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.153178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.153901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.154222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.154575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.155435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:35:43.155788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.157601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.171008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 728/1441] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:35:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:35:43.179245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.188551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1ee66-4e04-449f-abc2-daf69c662d54 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.193183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.193856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.194143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.194423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.195196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.197163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.311988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 714/1442] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:35:43 2021] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:35:43.316909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.327495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d1500-b77c-4630-a264-c92e922729a9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.385153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.385840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.386124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.386400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.387100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.389111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.494238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 729/1443] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:35:43 2021] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:35:43.498413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.510034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd88f-e6d3-4ffb-93e5-257bab2f8fdb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.514820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.515502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.515799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.516068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.516881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.518502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.532794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 715/1444] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:35:43.536865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.548560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196751-f649-4ed7-a84d-f26db1b3588c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.553701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.554518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.554797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.555734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.556560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.558246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eced36-7fdb-48d2-93a3-742c738dc8db admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.579356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 730/1445] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:35:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:35:43.582887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.593572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6758982-ca7b-44eb-8c84-3f64d22638e4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.598956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.600596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.600596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.600596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] PATH_INFO: `/v3/projects/c8f2641272f842e6b7517e23992ffb53/users/d21ae702eb6a4064a35b04aeef40e458/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.621962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f2641272f842e6b7517e23992ffb53, user_id=d21ae702eb6a4064a35b04aeef40e458, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:43.625129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:43.785194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 716/1446] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:35:43 2021] PUT /identity/v3/projects/c8f2641272f842e6b7517e23992ffb53/users/d21ae702eb6a4064a35b04aeef40e458/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:35:43.798018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca0f1-a5cb-4383-9414-bf2e6eed659d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:43.798294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca0f1-a5cb-4383-9414-bf2e6eed659d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:43.798598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca0f1-a5cb-4383-9414-bf2e6eed659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:43.824501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a8cca0f1-a5cb-4383-9414-bf2e6eed659d None None] MFA Rules not processed for user `d21ae702eb6a4064a35b04aeef40e458`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:35:43.825718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a8cca0f1-a5cb-4383-9414-bf2e6eed659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:43.890928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 731/1447] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:35:43 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:35:43.905819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:43.992826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b531-5f1d-4ec9-9717-c996c42478ce admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:43.999131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:43.999799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:44.000088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:44.000402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:44.009048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:44.010658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:44.020033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 717/1448] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:35:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:35:44.103768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce330e-eb27-44e9-bea0-f11817fc86a9 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:44.104536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce330e-eb27-44e9-bea0-f11817fc86a9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:44.104754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce330e-eb27-44e9-bea0-f11817fc86a9 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:44.106554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 732/1449] 10.222.0.21 () {52 vars in 829 bytes} [Tue Aug 10 03:35:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:35:44.110915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:44.179029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918938-9bfa-44c0-8157-abff408422b3 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:44.184577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:44.185452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:44.185732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:44.186006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] PATH_INFO: `/v3/users/d21ae702eb6a4064a35b04aeef40e458` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:44.187210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21ae702eb6a4064a35b04aeef40e458)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:44.188247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:35:44.188247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:35:44.188247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:35:44.189451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:44.429784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21ae702eb6a4064a35b04aeef40e458'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:44.430387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21ae702eb6a4064a35b04aeef40e458'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:44.431137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21ae702eb6a4064a35b04aeef40e458'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:44.445077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21ae702eb6a4064a35b04aeef40e458'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:44.468427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21ae702eb6a4064a35b04aeef40e458'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:44.562046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 718/1450] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:35:44 2021] DELETE /identity/v3/users/d21ae702eb6a4064a35b04aeef40e458 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:35:44.566529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:44.566823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:44.567104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:44.585094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:35:44.586319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:44.646229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 733/1451] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:35:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:35:44.656638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:44.658082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:44.721180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139331b7-05b2-451e-b7ce-1db2eb49a939 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:44.725172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:44.725880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:44.726208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:44.726531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:44.736824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:44.738490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd00e4-b1d6-4915-aa4f-6d5e5bec0d52 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:44.750192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 719/1452] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:35:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:35:45.324954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:35:45.327026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:35:45.340315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7742d-e209-48de-b18d-68514803c7b0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:35:45.354508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:35:45.354508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:35:45.354508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:35:45.354508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] PATH_INFO: `/v3/projects/c8f2641272f842e6b7517e23992ffb53` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:35:45.354822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f2641272f842e6b7517e23992ffb53)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:35:45.354822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:35:45.354822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:35:45.354822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:35:45.354822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:35:45.535839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f2641272f842e6b7517e23992ffb53', 'request_id': 'req-e7f03934-62f7-4644-895e-270a0eb02084'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:45.541605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f2641272f842e6b7517e23992ffb53', 'request_id': 'req-e7f03934-62f7-4644-895e-270a0eb02084'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:45.555581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f2641272f842e6b7517e23992ffb53', 'request_id': 'req-e7f03934-62f7-4644-895e-270a0eb02084'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:45.652996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] The token cache is being invalidate because project c8f2641272f842e6b7517e23992ffb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:35:45.658918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:45.658918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e7f03934-62f7-4644-895e-270a0eb02084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:35:45.658918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 734/1453] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:35:45 2021] DELETE /identity/v3/projects/c8f2641272f842e6b7517e23992ffb53 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:37:17.672352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499e82-8c9c-41cc-a258-e8d9810b2d08 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:17.672967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499e82-8c9c-41cc-a258-e8d9810b2d08 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:17.672967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06499e82-8c9c-41cc-a258-e8d9810b2d08 None None] PATH_INFO: `/v3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:17.674185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 720/1454] 10.222.0.63 () {54 vars in 926 bytes} [Tue Aug 10 03:37:17 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:37:17.681644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8937b-579e-4109-8283-13feddd68575 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:17.691036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8937b-579e-4109-8283-13feddd68575 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:17.691036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8937b-579e-4109-8283-13feddd68575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:17.701440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7fc8937b-579e-4109-8283-13feddd68575 None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:17.702661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7fc8937b-579e-4109-8283-13feddd68575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:17.766444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 735/1455] 10.222.0.63 () {58 vars in 1016 bytes} [Tue Aug 10 03:37:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:37:18.539990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:18.540365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:18.540697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:18.542607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 03:37:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:18.548095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4d2c-e628-4034-93c8-ed82372e8932 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:18.548436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4d2c-e628-4034-93c8-ed82372e8932 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:18.548723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4d2c-e628-4034-93c8-ed82372e8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:18.569440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5a9e4d2c-e628-4034-93c8-ed82372e8932 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:18.570664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5a9e4d2c-e628-4034-93c8-ed82372e8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:18.631125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 03:37:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:18.789036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:18.790846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:18.866467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a319e41-c792-4397-acb3-76702039aaf7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:18.873468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:18.874123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:18.874409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:18.874685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:18.884008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:18.885636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8b750-0237-4051-92d1-7328d8335ecb service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:18.895868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 722/1458] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:20.413225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0603-078c-435c-8935-860614ca79fa None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:20.413809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0603-078c-435c-8935-860614ca79fa None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:20.414079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a0603-078c-435c-8935-860614ca79fa None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:20.417125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 03:37:20 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:20.424340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf679b7-3c39-4f36-b559-b4fda30d0c27 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:20.424860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf679b7-3c39-4f36-b559-b4fda30d0c27 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:20.424977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf679b7-3c39-4f36-b559-b4fda30d0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:20.444286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cbf679b7-3c39-4f36-b559-b4fda30d0c27 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:20.445518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cbf679b7-3c39-4f36-b559-b4fda30d0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:20.453765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 03:37:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:20.609995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a0603-078c-435c-8935-860614ca79fa None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:20.625675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a0603-078c-435c-8935-860614ca79fa None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:20.631594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:20.632278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:20.632566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:20.632840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:20.641655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:20.643289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab670-0471-440a-90bf-225d96be95eb service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:20.653743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 738/1461] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:26.532863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc874-7697-4e83-94f0-30de7cba8e62 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:26.533422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc874-7697-4e83-94f0-30de7cba8e62 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:26.533422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cc874-7697-4e83-94f0-30de7cba8e62 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:26.535174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 724/1462] 10.222.0.21 () {54 vars in 960 bytes} [Tue Aug 10 03:37:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:26.540803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea81c-5b69-4852-bcb6-b032401d2e6e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:26.541343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea81c-5b69-4852-bcb6-b032401d2e6e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:26.541439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea81c-5b69-4852-bcb6-b032401d2e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:26.561896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f41ea81c-5b69-4852-bcb6-b032401d2e6e None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:26.563141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f41ea81c-5b69-4852-bcb6-b032401d2e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:26.572438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 739/1463] 10.222.0.21 () {58 vars in 1058 bytes} [Tue Aug 10 03:37:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:26.580596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc874-7697-4e83-94f0-30de7cba8e62 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:26.594178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cc874-7697-4e83-94f0-30de7cba8e62 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:26.599397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:26.600060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:26.600380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:26.600666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:26.609963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:26.611582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55644-5175-4808-a05c-fa1d40a01c3f service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:26.622698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 725/1464] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:32.471330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f963-aa3a-4f0f-91b3-c3e22e906f4a None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:32.472006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f963-aa3a-4f0f-91b3-c3e22e906f4a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:32.472006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142f963-aa3a-4f0f-91b3-c3e22e906f4a None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:32.474333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 03:37:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:37:32.480264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718c20-0224-4e0f-a1d2-f35dc41bfa0d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:32.480783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718c20-0224-4e0f-a1d2-f35dc41bfa0d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:32.480783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718c20-0224-4e0f-a1d2-f35dc41bfa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:32.500449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d2718c20-0224-4e0f-a1d2-f35dc41bfa0d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:32.501685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d2718c20-0224-4e0f-a1d2-f35dc41bfa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:32.513822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 03:37:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:32.670686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f963-aa3a-4f0f-91b3-c3e22e906f4a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:32.685987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142f963-aa3a-4f0f-91b3-c3e22e906f4a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:32.693472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:32.694158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:32.694435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:32.694752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:32.705717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:32.705717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e39d-328d-4f39-b9f0-cff7bf407d85 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:32.716000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 741/1467] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:34.201105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424562-9586-45e9-aaa4-bc8bb002103e None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:34.201674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424562-9586-45e9-aaa4-bc8bb002103e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:34.202252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424562-9586-45e9-aaa4-bc8bb002103e None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:34.205224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 03:37:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:34.211135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1344cf-50f1-4e6c-a957-2251826f64d8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:34.211670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1344cf-50f1-4e6c-a957-2251826f64d8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:34.211779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1344cf-50f1-4e6c-a957-2251826f64d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:34.231158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1f1344cf-50f1-4e6c-a957-2251826f64d8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:34.232383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1f1344cf-50f1-4e6c-a957-2251826f64d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:34.241713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 03:37:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:37:34.400070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424562-9586-45e9-aaa4-bc8bb002103e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:34.416932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424562-9586-45e9-aaa4-bc8bb002103e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:34.422391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:34.423036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:34.423325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:34.423603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:34.432741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:34.438289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7da24-8131-4fff-bd1d-aa38a7766b98 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:34.444604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 728/1470] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:37:38.694655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:38.695199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:38.695199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:38.697056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 743/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 03:37:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:38.703051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745ffe-7059-44ca-9398-6e32f2639641 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:38.703672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745ffe-7059-44ca-9398-6e32f2639641 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:38.703804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e745ffe-7059-44ca-9398-6e32f2639641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:38.722752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1e745ffe-7059-44ca-9398-6e32f2639641 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:38.723927 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1e745ffe-7059-44ca-9398-6e32f2639641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:38.731937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 729/1472] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 03:37:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:38.770305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:38.772030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:38.831132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31be4-9da1-431c-ac55-eb2256103b14 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:38.835297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:38.835948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:38.836275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:38.836557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:38.846173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:38.847788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3673b-f5a6-4348-8c11-b36c9f72ecff service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:38.858552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 744/1473] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:41.011624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23610-269c-4353-b4c0-78ca5b070ee7 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:41.012322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23610-269c-4353-b4c0-78ca5b070ee7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:41.012322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23610-269c-4353-b4c0-78ca5b070ee7 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:41.013978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 730/1474] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 03:37:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:41.020385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ecfd-541d-4efc-92d1-4b0ace1d5684 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:41.021154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ecfd-541d-4efc-92d1-4b0ace1d5684 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:41.021440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770ecfd-541d-4efc-92d1-4b0ace1d5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:41.038857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b770ecfd-541d-4efc-92d1-4b0ace1d5684 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:41.040100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b770ecfd-541d-4efc-92d1-4b0ace1d5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:41.048071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 745/1475] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 03:37:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:41.085563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23610-269c-4353-b4c0-78ca5b070ee7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:41.096670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23610-269c-4353-b4c0-78ca5b070ee7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:41.100169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:41.100841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:41.101125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:41.101404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:41.115314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:41.116797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad603c-a6fa-442e-8b81-5eaf12fe00cb service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:41.126316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 731/1476] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:37:44.837101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:44.837728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:44.837728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:44.839423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 746/1477] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 03:37:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:44.845348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d1bc-2edf-42b6-90e3-49166acae6e2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:44.845865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d1bc-2edf-42b6-90e3-49166acae6e2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:44.845995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260d1bc-2edf-42b6-90e3-49166acae6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:44.864819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0260d1bc-2edf-42b6-90e3-49166acae6e2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:44.866038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0260d1bc-2edf-42b6-90e3-49166acae6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:44.874001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 732/1478] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 03:37:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:44.926526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:44.928235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:44.983799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15cea4-5e7c-49b3-9cde-a10bbbc1d826 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:44.987353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:44.988771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:44.989055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:44.989327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:44.998716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:45.000435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe11a73-a4e4-4d60-8f64-6428b2035e5c service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:45.010828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 747/1479] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:37:47.168225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836e7d8-fc85-4621-a78d-65401ea4c569 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:47.168779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836e7d8-fc85-4621-a78d-65401ea4c569 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:47.168779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836e7d8-fc85-4621-a78d-65401ea4c569 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:47.170579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 733/1480] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 03:37:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:47.177156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6847-1367-44d0-b8f5-b0d747857ba1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:47.177640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6847-1367-44d0-b8f5-b0d747857ba1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:47.177820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6847-1367-44d0-b8f5-b0d747857ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:47.196121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ebcc6847-1367-44d0-b8f5-b0d747857ba1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:47.197357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ebcc6847-1367-44d0-b8f5-b0d747857ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:47.205078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 748/1481] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 03:37:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:47.257530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257527-bf9a-4981-8821-88c34270997f None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:47.257839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257527-bf9a-4981-8821-88c34270997f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:47.258109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92257527-bf9a-4981-8821-88c34270997f None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:47.259899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 734/1482] 10.222.0.21 () {54 vars in 966 bytes} [Tue Aug 10 03:37:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:37:47.265575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc2ca-ab01-4881-a948-10941419c328 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:47.265871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc2ca-ab01-4881-a948-10941419c328 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:47.266155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc2ca-ab01-4881-a948-10941419c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:47.284426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-41bfc2ca-ab01-4881-a948-10941419c328 None None] MFA Rules not processed for user `175949d4ebc945cdb0b0a43c8b223f16`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:37:47.285625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-41bfc2ca-ab01-4881-a948-10941419c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:37:47.292261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 749/1483] 10.222.0.21 () {58 vars in 1064 bytes} [Tue Aug 10 03:37:47 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:37:47.301088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257527-bf9a-4981-8821-88c34270997f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:37:47.311724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92257527-bf9a-4981-8821-88c34270997f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:37:47.315280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:37:47.315928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:37:47.316840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:37:47.317117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:37:47.327582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:37:47.329057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33028e-8f9b-483b-83ba-a8ec5d2a5b34 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:37:47.338712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 735/1484] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:37:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:10.657039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.658135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.658644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.695307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:10.697458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:10.713575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 750/1485] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:10.722772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e879a2-811c-4c7a-9ae1-5ee864ff1456 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.723709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e879a2-811c-4c7a-9ae1-5ee864ff1456 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.724222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e879a2-811c-4c7a-9ae1-5ee864ff1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.753014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b6e879a2-811c-4c7a-9ae1-5ee864ff1456 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:10.754578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b6e879a2-811c-4c7a-9ae1-5ee864ff1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:10.764541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 736/1486] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:10.770272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:10.792700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfe57d-c011-4f52-974b-05a3e302c5ad None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:10.805580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:10.806749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.807227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.807724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.809298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:10.809855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:10.812925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:10.820358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656bd2-e600-4ca0-bc43-1cdf4faabd1b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.821004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656bd2-e600-4ca0-bc43-1cdf4faabd1b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.821502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c656bd2-e600-4ca0-bc43-1cdf4faabd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.848224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 751/1487] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:10.855458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5c656bd2-e600-4ca0-bc43-1cdf4faabd1b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:10.856968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5c656bd2-e600-4ca0-bc43-1cdf4faabd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:10.863127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:10.871393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 737/1488] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:10.880577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.881165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.881670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.887003 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371a3d-e4bc-48c4-9851-4004b31c202b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:10.903094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:10.904584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.905395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.906547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.908647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:10.910592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:10.911890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:10.912943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1337f-3081-4455-83a7-393776bbe8d0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:10.930919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 738/1489] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:10.935265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:10.949580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492105f-b71e-46ba-b4f2-0468aa113fc0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:10.959017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:10.960078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:10.960692 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:10.964706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:10.964706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:10.964706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:10.964706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:10.982342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 739/1490] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:39:10.991671 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.005194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d0804-dd35-4e15-be21-9894f4caf20c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.018622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.019743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.020289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.020795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.022011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.025933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.099058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 752/1491] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:11.101283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.101798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.102297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.156637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.158552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.198822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 740/1492] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:10 2021] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:11.200413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.271941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 753/1493] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.273729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.312311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda1d0a-b1f6-413b-96a3-068bc1582f88 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.370408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a4cb-0cdc-4826-9049-ec0bb0f9db6e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.387216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.388235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.388729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.389200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.390334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.393997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3971-29e4-4b97-bec3-9d4d71938266 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.468524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.470033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.471197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.471505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.472231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.474506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6342a-0a99-4405-9efe-4c7d2c7104cc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.551809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 741/1494] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:11.553168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ccfd-c54c-4d4e-8db3-6cf22e8f14e6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.553463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ccfd-c54c-4d4e-8db3-6cf22e8f14e6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.553742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ccfd-c54c-4d4e-8db3-6cf22e8f14e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.573056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b5a5ccfd-c54c-4d4e-8db3-6cf22e8f14e6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.577563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b5a5ccfd-c54c-4d4e-8db3-6cf22e8f14e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.582525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 742/1495] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.583797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c7eb-3442-44db-b742-121571c7b854 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.584087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c7eb-3442-44db-b742-121571c7b854 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.584394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c7eb-3442-44db-b742-121571c7b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.603025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ba61c7eb-3442-44db-b742-121571c7b854 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.604234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ba61c7eb-3442-44db-b742-121571c7b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.619734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 743/1496] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.619734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.619734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.619734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.620164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 754/1497] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/users => generated 290 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:11.621106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5230-a4b8-496e-97ce-772393467265 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.621398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5230-a4b8-496e-97ce-772393467265 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.621679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5230-a4b8-496e-97ce-772393467265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.638582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.639775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.643006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4d9b5230-a4b8-496e-97ce-772393467265 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.644179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4d9b5230-a4b8-496e-97ce-772393467265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.654741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 755/1498] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.655124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 744/1499] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.655232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00e6f-a149-48a7-9dbe-50fef698cbe6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.655313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.655411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00e6f-a149-48a7-9dbe-50fef698cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.655411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e00e6f-a149-48a7-9dbe-50fef698cbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.665936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902790-660d-41d7-ba67-72800253bfa8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.670701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.671454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.671743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.672048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.673008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.674272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-60e00e6f-a149-48a7-9dbe-50fef698cbe6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.675410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.675529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-60e00e6f-a149-48a7-9dbe-50fef698cbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.685334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 756/1500] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.686546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.686838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.687112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.695698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 745/1501] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:11.695698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.705498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fd81-a8b0-4fb8-be5c-b1ede6cc481a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.705814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.707055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.710228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.710926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.711182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.711467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.712218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.713847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a712a1-d4d3-4ee4-b18f-1dba010a571a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.715858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 757/1502] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.716481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.727371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21665b4-82ef-4b15-8986-d6537ebc300f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.732301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.737905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 746/1503] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:11.738697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.738697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.738697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.739126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9473a-3ae4-42a7-af6b-b339b059d639 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.739258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:11.739403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9473a-3ae4-42a7-af6b-b339b059d639 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.739543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.739679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9473a-3ae4-42a7-af6b-b339b059d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.740431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736d4e-e7ee-4868-9be3-1a7a89ee5f9f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.749037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 758/1504] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:11.757840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.758606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.759118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.760464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-51f9473a-3ae4-42a7-af6b-b339b059d639 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.761681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-51f9473a-3ae4-42a7-af6b-b339b059d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.770257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 747/1505] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.771588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.771877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.772157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.781928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.783174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.790701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.791383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 759/1506] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.791898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.792237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.804712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 748/1507] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.804712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.805065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c7846-8433-42b6-82e5-61514635998c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.807135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.807841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.808130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.808452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.809189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.810817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.811805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b3792-6dc6-4ccd-a0ab-fb944fbb9e92 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.817201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.817880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.818169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.818448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.819213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:11.819659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.821197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.821918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 760/1508] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:11.822766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.833702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425822ac-9234-48b5-8f83-7bfb2c2a1565 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.834492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 749/1509] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:11.835399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.844557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.845280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.845551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0aa3c-c0d0-4331-aee9-46a10c1b87d5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.845654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.845845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.846605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.848231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87c80e-3726-4452-80e6-6e68e1de1bcb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.850332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.851074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.851366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.851653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.852383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.854288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.858674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 761/1510] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:11.859909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.860221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.860506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.880084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:11.887634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:11.889523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 762/1511] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:11.890333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.899996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a0b7f-5f9d-4ce7-96a6-b7ecd4932650 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.904718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.905378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.905668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.905952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.906721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:11.907036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.908708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.920731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 763/1512] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:11.921610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.932014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30bb9-fe05-46a3-bf82-3182d2d86150 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.936755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.937417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.937706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.937982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.938725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:11.939604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.941244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.954022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 764/1513] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:11.954994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.964676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257210df-5505-45a6-b5c5-8496dfa3c34e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:11.969386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:11.970036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:11.970323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:11.970600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:11.971321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:11.971632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:11.973289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:11.981145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 750/1514] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:11.981906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:11.989059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 765/1515] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:11.990087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.000367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4d8f4-8c5b-43c9-9545-5823af5373a0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.044222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92720f4d-3077-4f16-95e6-95b99a84865c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.049510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.050400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.050689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.050973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] PATH_INFO: `/v3/projects/098d020e6c2a497a939e7c54eb5cc81a/users/84e7b0c8858f4616ad809fb025ffa9ff/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.055628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.056333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.056618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.056896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.057582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.059523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6291-b8ee-4276-8f05-e631e70c042a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.066907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098d020e6c2a497a939e7c54eb5cc81a, user_id=84e7b0c8858f4616ad809fb025ffa9ff, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.069631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.185439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 751/1516] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:11 2021] PUT /identity/v3/projects/098d020e6c2a497a939e7c54eb5cc81a/users/84e7b0c8858f4616ad809fb025ffa9ff/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:12.186270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.203489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 766/1517] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:11 2021] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.204936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.205275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.205606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.224361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:12.226471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:12.251058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8803d6-09ab-4dab-8b2d-e6b28454cf66 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.286571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 767/1518] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:12.287639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.297231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886531-ec35-42df-92e1-8621f4b36dd2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.302749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.303412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.303699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.303978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.304710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.306634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.307847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.308782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.309062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.309337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] PATH_INFO: `/v3/projects/02cb87684af34e389239670bfe0eb2af/users/09b063b3c1f344f5818b55f29b349571/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.323878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cb87684af34e389239670bfe0eb2af, user_id=09b063b3c1f344f5818b55f29b349571, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.326565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.448792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 768/1519] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.449621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.485708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 752/1520] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:12 2021] PUT /identity/v3/projects/02cb87684af34e389239670bfe0eb2af/users/09b063b3c1f344f5818b55f29b349571/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:12.487375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.522709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a03732-3702-4eba-97f8-147e0b0ed20b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.551150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945e73-0e0f-4fb4-9f5c-fab4c2b759ce admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.556024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.556752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.557040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.557319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.558067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.559992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.579152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.585005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.585005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.585005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.585005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.585005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ee966-fb1a-4d85-999f-1fe4b1050de2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.676505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 753/1521] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.677315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.686736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7818f4-d65f-4bed-8a74-4149fd53bfeb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.692465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 769/1522] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/projects => generated 403 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.692465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.692465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.692465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.694174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.694744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.696915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.696915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.696915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.698012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.710860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:12.713860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:12.777567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 770/1523] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:12.779113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.795521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fd621-2e35-43a9-8739-f009a5a20696 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.803045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.803262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 754/1524] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.804155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.804307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.804650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.805119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.806272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.809754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cdf88-bded-4c83-b9ac-2a9cd2e7b078 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.867453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9d9b0-4f69-4dd7-acab-7338b3618dc4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.872329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.872988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.873275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.873555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.874272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:12.874582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.876239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.887419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 755/1525] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:12.888177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.898145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a21b2b-9bd4-430c-b533-0ce7223163b7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.903096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.903739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.904027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.904341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.905029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.906912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.916889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 771/1526] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:12.922217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.922217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.922217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.935863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:12.937105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:12.945049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 772/1527] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:12.945857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.955924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a4f5a-70a0-4ea7-ae95-6a2ef43d9369 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.960884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.961551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:12.961981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:12.962263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:12.963144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:12.964817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:12.975982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 773/1528] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:12.977192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:12.987104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507a011-89bd-4442-84ee-b2a59e1a8890 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:12.991722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:12.992424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.000650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.000650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.000650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.000650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.039924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 756/1529] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:13.039924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.097926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5c8e5-6c1f-40c6-838a-0596f261ece8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.101851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.103080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.103080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.103080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.110913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 774/1530] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:12 2021] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:13.110913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.121862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.123201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64a08-e0ae-4e44-9c67-efd75ca88d51 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.125786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.128683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.129371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.129692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.130005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.130718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.132793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.146964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 757/1531] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:13.149232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.166778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d935874-a7c2-48e1-9589-04acd75652b2 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.176659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.177889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.178391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.178895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.180242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.183459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.254288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 775/1532] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:13 2021] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:13.255158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.264744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850ca8-c03b-4d2e-be6f-8062e7ebf366 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.269516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.270181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.270461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.270735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.271450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.273104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.284188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 776/1533] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.285041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.296142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba5f7-5e73-4584-8e54-ce8af94429c4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.297438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 758/1534] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:13 2021] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:13.298977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.353626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.354301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.354751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.354895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.371959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0ed4-279c-41ee-a05a-a5dba6732440 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.379026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.379843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.380265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.380649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.381487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.383190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.397558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 759/1535] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.397558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.407682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6de9f-eec5-42bc-b26f-80fc9fe6df30 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.412856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.413512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.413877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.414120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.414970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.416648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.421347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.422990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.427962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 760/1536] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.428997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.436511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 777/1537] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:13.437265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.439874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d132-6d85-4a4b-b7e6-53c0694e506a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.446169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.447001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.447597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.447748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.448217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d681f3-889e-431a-bf7c-d2e453b36c62 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.448536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.450194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.453324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.454076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.454363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.455173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.455896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.457735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.465385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 761/1538] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.465385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.468428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 778/1539] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.469281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.476359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153870ce-0183-4140-8d2c-9f273d72c3d7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.479377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49eef8e-7b75-484a-8587-5dcc11311fe3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.481162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.481886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.482239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.482587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.483368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.484051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.484812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.485103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.485235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.485384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.486133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.488386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.495843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 762/1540] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.496658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.510494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d142cc-e8f7-495e-885f-2e78466b3cc8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.515629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.516564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.516850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.517653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] PATH_INFO: `/v3/projects/95b081479da94713968106a7f24f0a9f/users/05318ccc5ddf4a9b93f278e26a99c1db/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.532427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b081479da94713968106a7f24f0a9f, user_id=05318ccc5ddf4a9b93f278e26a99c1db, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.535232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.614971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 779/1541] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:13 2021] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:13.620250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.625263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de3f4c-26f5-4922-9112-5e4fbb3ff866 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.630742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.631406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.631741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.632024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.632792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.634389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.645975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 780/1542] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.646823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.656915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f3bf1-f950-4807-914f-b902e44275c3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.661943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.662613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.662904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.663184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.663940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.666458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.678821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 781/1543] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.679862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.688731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 763/1544] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:13 2021] PUT /identity/v3/projects/95b081479da94713968106a7f24f0a9f/users/05318ccc5ddf4a9b93f278e26a99c1db/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:13.700528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.700816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e44f3-13fe-442c-abba-e9caf76ecc0d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.767101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8abe-8067-425d-bcbd-3333c91f4dd8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.782371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.785116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.785116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.785116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.785490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.786040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.787017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.787410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.787655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.787955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] PATH_INFO: `/v3/projects/0218bd23bab4457abfb072f168e61af6/users/cb4a0eaef1ba4df5a07bda5bef95dd99/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.800069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 782/1545] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.801517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.813217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1223f-9bfb-491d-ad27-1e74b110a5e8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.824694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.825378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.825661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.825934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.826854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.828734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.830782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0218bd23bab4457abfb072f168e61af6, user_id=cb4a0eaef1ba4df5a07bda5bef95dd99, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.833581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.848419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 783/1546] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:13 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:13.849378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.862542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6365a1-6c0d-442f-bf6c-9478e8c22a95 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.867981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.871553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.871553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.871553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] PATH_INFO: `/v3/projects/db9e9e54834e4fe682d4305010655be7/users/e2a2db05b54e45fba8475e7949a61d6a/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:13.885391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9e9e54834e4fe682d4305010655be7, user_id=e2a2db05b54e45fba8475e7949a61d6a, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:13.888127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023d867-b97f-4bc0-b652-0d814897d50c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:13.925653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 764/1547] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:13 2021] PUT /identity/v3/projects/0218bd23bab4457abfb072f168e61af6/users/cb4a0eaef1ba4df5a07bda5bef95dd99/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:13.926557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:13.989155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e3ba9-c552-48a1-a7ad-543cfab31eec admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:13.994109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:13.995099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:13.995453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:13.995798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] PATH_INFO: `/v3/projects/4b3175ba28ab4593b82d519d68b922f9/users/d07e39a420aa44dfb1a652eeead2a12b/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.012011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3175ba28ab4593b82d519d68b922f9, user_id=d07e39a420aa44dfb1a652eeead2a12b, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.014891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.024189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 784/1548] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:13 2021] PUT /identity/v3/projects/db9e9e54834e4fe682d4305010655be7/users/e2a2db05b54e45fba8475e7949a61d6a/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:14.025740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.025740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.026039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.063671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] MFA Rules not processed for user `05318ccc5ddf4a9b93f278e26a99c1db`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.063671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.133394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 785/1549] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.134318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.138812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 765/1550] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:13 2021] PUT /identity/v3/projects/4b3175ba28ab4593b82d519d68b922f9/users/d07e39a420aa44dfb1a652eeead2a12b/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:14.141365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.199878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5ec09-29cd-4143-bca8-22beca744b7d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.201089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4315c-2e64-49c0-b38b-d00392522236 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.205619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.206215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.206515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.206802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.206900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.207080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] PATH_INFO: `/v3/projects/d0fc244d6ab34d918c770446c595ec4f/users/7e263de47d374f2f9a910b930283c2c8/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.207178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.207415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.208137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.209820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf42e3-174c-4536-bcf3-982bf7c03ead admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.219742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 766/1551] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:14.221508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6760df-2888-44fe-a61a-0c2867ef91c6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.221809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6760df-2888-44fe-a61a-0c2867ef91c6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.222097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6760df-2888-44fe-a61a-0c2867ef91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.222471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fc244d6ab34d918c770446c595ec4f, user_id=7e263de47d374f2f9a910b930283c2c8, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.225269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92976105-7180-43f0-ba12-ad9db07d6b85 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.240965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3c6760df-2888-44fe-a61a-0c2867ef91c6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.242213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3c6760df-2888-44fe-a61a-0c2867ef91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.250997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 767/1552] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.252939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.253227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.253501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.272426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.273994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.281919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 768/1553] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.282804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.293194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386f458-d38a-4c43-b81e-4fa4e315f7ec None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.297994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.299261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.299632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.299947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.300754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.302751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.351818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 786/1554] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:14 2021] PUT /identity/v3/projects/d0fc244d6ab34d918c770446c595ec4f/users/7e263de47d374f2f9a910b930283c2c8/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:14.353286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.353582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.353862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.374092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.376224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.454474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 787/1555] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.455425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.465851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 769/1556] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:14.467524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.468340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402482e7-5f6e-4f25-88b5-32020ce5b743 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.472745 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.534883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.535949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.536382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.536765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] PATH_INFO: `/v3/projects/05aa352203a74307bd3b6157f78f6b97/users/f4e6c08307964f198aa7efc7961aa09f/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.540777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2fa23-d07c-419b-843f-ffd855c28301 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.545029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.545699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.546031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.546472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.557538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.559049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.568634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05aa352203a74307bd3b6157f78f6b97, user_id=f4e6c08307964f198aa7efc7961aa09f, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.569503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 770/1557] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:14.570337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.574103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.579043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769aafac-1c12-40bd-a7a7-524f06332862 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.583145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.583803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.584088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.584472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.596838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.598683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429ddb1-d15c-4ed8-b932-738c48993ed5 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.608910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 771/1558] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:14.610156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.610454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.610764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.638506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] MFA Rules not processed for user `7e263de47d374f2f9a910b930283c2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.639726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.682162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 788/1559] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:14 2021] PUT /identity/v3/projects/05aa352203a74307bd3b6157f78f6b97/users/f4e6c08307964f198aa7efc7961aa09f/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:14.683317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.713473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 772/1560] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.714345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.728222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c990-0202-4cdf-bfd4-7c38266bd9f9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.755260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b61a90-dfc7-472a-9ff4-0ac068a639a3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.761206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.762028 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.762381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.762728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.763563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.766910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.798270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.798935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.799225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.799499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.809710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.811204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd52d8-2a5e-43ec-b297-45bac86b0d1a service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.821806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 773/1561] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:14.823119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e5ea-6939-45d2-b545-93d0b3cb1683 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.823410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e5ea-6939-45d2-b545-93d0b3cb1683 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.823682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73e5ea-6939-45d2-b545-93d0b3cb1683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.843455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3b73e5ea-6939-45d2-b545-93d0b3cb1683 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.846375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3b73e5ea-6939-45d2-b545-93d0b3cb1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.852957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 774/1562] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.854419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7b12-49bb-4f7f-a20c-0325a03f863e None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.854718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7b12-49bb-4f7f-a20c-0325a03f863e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.855001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7b12-49bb-4f7f-a20c-0325a03f863e None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.856823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 775/1563] 10.222.0.21 () {54 vars in 961 bytes} [Tue Aug 10 03:39:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:14.865591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.865835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.866145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.890768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:14.890768 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:14.958551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 776/1564] 10.222.0.21 () {58 vars in 1059 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:14.959437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:14.969205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdfce6-1d05-48f1-a0ac-a0ea01654088 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:14.973717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:14.974388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:14.974670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:14.974951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:14.984822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:14.986328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:14.998790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 777/1565] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:14.999766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.009727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 789/1566] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:14 2021] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:15.040529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a360aec-e8bf-4015-b8ee-fecc765b452e service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.040954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.041058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.041058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.041058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.041058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.041417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b69be-48f6-4a0a-8b8f-4e1c4c5f589d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.041417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.041417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.041417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.041752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.041752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.041752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.053221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 790/1567] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:15.057111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.068374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78589-e744-410d-a033-1f07f93a70d0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.074194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.075409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.075847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.076332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] PATH_INFO: `/v3/projects/de5fd130bbd34b348ebe07259e19f3c8/users/45f338927864470091d0c28a07339696/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.096870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5fd130bbd34b348ebe07259e19f3c8, user_id=45f338927864470091d0c28a07339696, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.100081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.120271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.122024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.132495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 778/1568] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:14 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:15.534267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 791/1569] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:15 2021] PUT /identity/v3/projects/de5fd130bbd34b348ebe07259e19f3c8/users/45f338927864470091d0c28a07339696/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:15.544631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.555673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525e884-3c4c-4974-9eba-83ce00c24055 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.619735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.620445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.620732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.621043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.621784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.623564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193644d-447b-4255-bfa3-7331f6b5b703 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.635184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 779/1570] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:15 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:15.639061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.649942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4b103-96a9-4883-a140-11536e7c936c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.656771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b8f0-cbd7-472f-a9fb-5ccd7c788838 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.656771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b8f0-cbd7-472f-a9fb-5ccd7c788838 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.656771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705b8f0-cbd7-472f-a9fb-5ccd7c788838 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.656771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 780/1571] 10.222.0.21 () {54 vars in 961 bytes} [Tue Aug 10 03:39:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:15.657941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.659333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c842-1608-417b-904b-972646d11fe0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.659632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c842-1608-417b-904b-972646d11fe0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.659938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c842-1608-417b-904b-972646d11fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.662232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.662461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.662792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] PATH_INFO: `/v3/projects/de5fd130bbd34b348ebe07259e19f3c8/users/45f338927864470091d0c28a07339696/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.665222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5fd130bbd34b348ebe07259e19f3c8, user_id=45f338927864470091d0c28a07339696, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.667847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553729a-b8bc-4441-bdc4-fbf5ba2b7392 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.682081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 792/1572] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:15 2021] PUT /identity/v3/projects/de5fd130bbd34b348ebe07259e19f3c8/users/45f338927864470091d0c28a07339696/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:15.691544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cd78c842-1608-417b-904b-972646d11fe0 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:15.691544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cd78c842-1608-417b-904b-972646d11fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:15.693474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.700876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.700876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.747616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] MFA Rules not processed for user `45f338927864470091d0c28a07339696`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:15.748881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:15.801303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 781/1573] 10.222.0.21 () {58 vars in 1059 bytes} [Tue Aug 10 03:39:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:15.808576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653431-38ca-4e4b-9cac-5d680c0d8081 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.808873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653431-38ca-4e4b-9cac-5d680c0d8081 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.809160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4653431-38ca-4e4b-9cac-5d680c0d8081 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.811604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 782/1574] 10.222.0.21 () {54 vars in 912 bytes} [Tue Aug 10 03:39:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:39:15.817973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.818417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.818758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.840675 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:15.841911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:15.843095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 793/1575] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:15 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:15.853063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 783/1576] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:39:15 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:15.856993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.880253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:15.936978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b45cb-bb36-4df8-a959-1fc619a7d47d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.947565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.948936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.949482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.950370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.956605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5514f17-ac54-4879-a459-fc1f5581554f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:15.962529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:15.963403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:15.963938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:15.964513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:15.967712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.971242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97be17-633c-4e48-9b61-ffc55c88458c service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:15.983881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:15.987486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d613e4-5a00-4813-9ba2-2fe230096851 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:16.004986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 794/1577] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:15 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:16.015807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 784/1578] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:16.155628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482dde-b2c4-4403-bafa-cc0979044acf None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.156041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482dde-b2c4-4403-bafa-cc0979044acf None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.156671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482dde-b2c4-4403-bafa-cc0979044acf None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.159847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 795/1579] 10.222.0.21 () {54 vars in 912 bytes} [Tue Aug 10 03:39:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:16.167088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3a37-58b0-4aed-b3b9-ff5a827b9b64 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.167394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3a37-58b0-4aed-b3b9-ff5a827b9b64 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.167681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c3a37-58b0-4aed-b3b9-ff5a827b9b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.189201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a35c3a37-58b0-4aed-b3b9-ff5a827b9b64 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:16.190544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a35c3a37-58b0-4aed-b3b9-ff5a827b9b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:16.200503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 785/1580] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:39:16 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:16.212435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482dde-b2c4-4403-bafa-cc0979044acf None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:16.223973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482dde-b2c4-4403-bafa-cc0979044acf None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:16.227855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:16.228710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.235563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.235563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.255508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f5e1-460d-4077-8223-b8383ce86f01 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.255732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:16.256515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f5e1-460d-4077-8223-b8383ce86f01 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.257009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f5e1-460d-4077-8223-b8383ce86f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.257624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:16.275204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 796/1581] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:16.303594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0155f5e1-460d-4077-8223-b8383ce86f01 None None] MFA Rules not processed for user `09b063b3c1f344f5818b55f29b349571`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:16.305068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0155f5e1-460d-4077-8223-b8383ce86f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:16.337671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:16.350731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b4a70-a024-4300-8c2f-1716ad7f9743 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:16.370291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:16.371883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.372347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.372823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.405706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 786/1582] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:16 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:16.417452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.419273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.419710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.451180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] MFA Rules not processed for user `09b063b3c1f344f5818b55f29b349571`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:16.452758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:16.462323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 787/1583] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:16 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:16.463370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:16.469644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:16.472448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:16.484081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 797/1584] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:16 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:16.494026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:16.515935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7e09c-1a49-4254-835c-b46b88e496f7 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:16.528558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:16.529993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.530445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.530896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.541375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:16.543741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6582-5c14-4bed-9884-fb3dd2c05406 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:16.554604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 798/1585] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:16 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:16.577064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991079-7af6-44a3-95fa-f06072daa753 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:16.592232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:16.592940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:16.593400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:16.594303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] PATH_INFO: `/v3/users/7e263de47d374f2f9a910b930283c2c8` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:16.595918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e263de47d374f2f9a910b930283c2c8)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:16.598256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:16.921712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e263de47d374f2f9a910b930283c2c8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:16.922494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e263de47d374f2f9a910b930283c2c8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:16.925520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e263de47d374f2f9a910b930283c2c8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:16.933542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e263de47d374f2f9a910b930283c2c8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:16.949534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ef42b48a-1a2e-48a2-8682-4dd55015d316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e263de47d374f2f9a910b930283c2c8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:16.999571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7de4b-46ea-4bab-970e-d9aa00b4e50a None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:17.000478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7de4b-46ea-4bab-970e-d9aa00b4e50a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:17.000795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7de4b-46ea-4bab-970e-d9aa00b4e50a None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:17.002874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 799/1586] 10.222.0.21 () {54 vars in 912 bytes} [Tue Aug 10 03:39:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:39:17.009189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:17.009627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:17.009969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:17.056970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:17.058421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:17.110704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 788/1587] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:16 2021] DELETE /identity/v3/users/7e263de47d374f2f9a910b930283c2c8 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:17.113387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:17.113744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:17.114139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:17.138477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 800/1588] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:39:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:17.150244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:17.153372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:17.186049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:17.192628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:17.201539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a4b8c-d46b-4e5b-949e-48c824faf327 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:17.291031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:17.295916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:17.295916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:17.295916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:17.307627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:17.307627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:17.316893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 801/1589] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:17 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:17.343824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 789/1590] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:17.375048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:17.377583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:17.390527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293a8a1-deb1-41f1-9c49-c81870078bde service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:17.395245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:17.396097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:17.396593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:17.396879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:17.407708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:17.409244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37379bd7-720a-499a-a597-7810ec108039 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:17.420761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 802/1591] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:18.189735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:18.191830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:18.282184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6b006-bc0b-44d6-86c6-97f9b16b6e63 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:18.288547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:18.289199 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:18.289530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:18.290095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:18.293115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:18.307153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:18.309071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc2424-39c2-4212-9c24-989a41e2f12c service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:18.321658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 790/1592] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:18.660443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a8f5-5ee3-4502-8d8c-38f2aed5ec4d None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:18.660443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a8f5-5ee3-4502-8d8c-38f2aed5ec4d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:18.660443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7a8f5-5ee3-4502-8d8c-38f2aed5ec4d None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:18.662047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 803/1593] 10.222.0.21 () {54 vars in 960 bytes} [Tue Aug 10 03:39:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:18.670088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:18.670839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:18.671194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:18.701365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] MFA Rules not processed for user `2fbee68034fe479e8e77af166c12f778`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:18.702723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:18.719695 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 791/1594] 10.222.0.21 () {58 vars in 1058 bytes} [Tue Aug 10 03:39:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:18.731790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a8f5-5ee3-4502-8d8c-38f2aed5ec4d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:18.752741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7a8f5-5ee3-4502-8d8c-38f2aed5ec4d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:18.761092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:18.762181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:18.762531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:18.762964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:18.765182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:18.782052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:18.785282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e29fd-e1de-4b7f-a894-b2b8bdee9283 service placement] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:18.797701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 804/1595] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:19.451774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:19.456438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:19.474062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cee38-3649-41b9-89b0-76a8596b4032 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:19.478875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:19.479753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:19.480069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:19.480456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] PATH_INFO: `/v3/projects/d0fc244d6ab34d918c770446c595ec4f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:19.481846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fc244d6ab34d918c770446c595ec4f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:19.482867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: WARNING py.warnings [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:19.482867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: warnings.warn(msg) Aug 10 03:39:19.482867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: Aug 10 03:39:19.484072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:19.550708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93270a-b180-4818-a69d-ce5682534d7f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:19.551091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93270a-b180-4818-a69d-ce5682534d7f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:19.551287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93270a-b180-4818-a69d-ce5682534d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:19.591511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fc93270a-b180-4818-a69d-ce5682534d7f None None] MFA Rules not processed for user `cb4a0eaef1ba4df5a07bda5bef95dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:19.592174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fc93270a-b180-4818-a69d-ce5682534d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:19.697651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 805/1596] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:19 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:19.700493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:19.701011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:19.701478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:19.714934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fc244d6ab34d918c770446c595ec4f', 'request_id': 'req-091fe599-506a-40c8-871c-a1f42f1b725a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:19.738990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] MFA Rules not processed for user `cb4a0eaef1ba4df5a07bda5bef95dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:19.741899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:19.755508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fc244d6ab34d918c770446c595ec4f', 'request_id': 'req-091fe599-506a-40c8-871c-a1f42f1b725a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:19.862289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 806/1597] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:19 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:19.879297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:19.881629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:19.963202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fc244d6ab34d918c770446c595ec4f', 'request_id': 'req-091fe599-506a-40c8-871c-a1f42f1b725a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:19.998934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] The token cache is being invalidate because project d0fc244d6ab34d918c770446c595ec4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:20.000950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:20.005372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-091fe599-506a-40c8-871c-a1f42f1b725a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:20.013988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 792/1598] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:19 2021] DELETE /identity/v3/projects/d0fc244d6ab34d918c770446c595ec4f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:20.017316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.019551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.020106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.047042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044c69-56a2-4873-b2cd-bd00db741535 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.061522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.062201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.062481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.062762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.070171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:20.088499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:20.088921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:20.099780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.102439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263871e4-742c-492b-9af1-baabc7dc32c6 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.136420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 807/1599] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:19 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:20.207464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 793/1600] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:20.215308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.215686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.215974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.239231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:20.240909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:20.252626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 808/1601] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:20.256945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.268828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04013024-92b1-4108-8bfd-3f3a17e0a6e7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.274257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.275482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.275924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.276393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.277488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:20.277953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.279722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.295530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 794/1602] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:20.299941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.313181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a4588-d05a-4a49-b8bc-d7855cfb9368 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.319099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.319776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.320446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.320446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.321052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.323476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.460363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.467176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 809/1603] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:20 2021] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:20.474396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759406c-844f-4beb-a4bb-86fdf482d1bf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.562879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.564527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.565047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.565536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.566441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.569134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e2e77-4dac-4f28-bd60-2459f5bfa436 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.774968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 795/1604] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:20 2021] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:20.778963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.791837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f68c00-84e6-4663-990e-db66b51a298f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.797272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.799490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.799943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.800432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.801337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.815398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab5ac8-4dbf-460a-87e7-bc941d5f6c63 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.839775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714063-59a6-4914-9bcf-998b45de3887 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.840351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714063-59a6-4914-9bcf-998b45de3887 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.840800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd714063-59a6-4914-9bcf-998b45de3887 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.843159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 796/1605] 10.222.0.21 () {54 vars in 912 bytes} [Tue Aug 10 03:39:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:39:20.848471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd714063-59a6-4914-9bcf-998b45de3887 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.851069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 810/1606] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:20 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:20.853140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.854435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.855340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.869737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd714063-59a6-4914-9bcf-998b45de3887 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.886154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.887056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.887518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.888296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.889213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.891015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:20.898587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:20.903394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:20.914421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 797/1607] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:20 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:20.919038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:20.943724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37296bd9-8e78-4262-979f-20a2daeb8d6e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:20.958250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:20.959553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:20.960021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:20.960474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] PATH_INFO: `/v3/projects/ebb39df793f046399bb5538fb4b05158/users/7646937c928b4f2ba2973afb479c33d3/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:20.990477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb39df793f046399bb5538fb4b05158, user_id=7646937c928b4f2ba2973afb479c33d3, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:20.993181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:21.004045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 811/1608] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:39:20 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:21.039207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:21.040847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:21.056118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203590b8-cc8a-4dac-b145-09625ad4c110 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:21.069850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:21.070665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.071037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.071626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.086120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:21.087966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641beea-4409-4f58-869f-1aff4e73e94a service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:21.108307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 812/1609] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:39:21.197518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 798/1610] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:20 2021] PUT /identity/v3/projects/ebb39df793f046399bb5538fb4b05158/users/7646937c928b4f2ba2973afb479c33d3/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:21.209219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.209591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.209944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.240684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] MFA Rules not processed for user `7646937c928b4f2ba2973afb479c33d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:21.242623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:21.315169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 813/1611] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:21 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:21.319254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:21.415598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545a20-3f40-4148-b153-ad1796c6072f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:21.422300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:21.422940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.423551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.424105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.425333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:21.427043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68a7f1-59bc-43c8-812e-d70a248578d3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:21.610797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 799/1612] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:21 2021] POST /identity/v3/projects => generated 379 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:21.615891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:21.626765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7ea91-10b5-4ec0-9f07-e504de472b11 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:21.725601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:21.729441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.729860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.730222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.732512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:21.738806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:21.840020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.840523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.840982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.866027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 814/1613] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:21 2021] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:21.867109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:21.897783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0cccc-5392-4039-9eed-e444855a7166 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:21.901183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] MFA Rules not processed for user `d07e39a420aa44dfb1a652eeead2a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:21.902715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:21.913844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:21.915007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.915474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.916064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:21.916968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:21.918802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:21.955583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 815/1614] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:21 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:21.956859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:21.974626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d019678e-5b9b-401e-98c2-7635e368f3dc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:21.980691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:21.981851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:21.982401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:21.983109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] PATH_INFO: `/v3/projects/c960590f10854697bd6d178b738e8c36/users/0d4d44a32929468782603f5acead061d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.002793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c960590f10854697bd6d178b738e8c36, user_id=0d4d44a32929468782603f5acead061d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.005999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.051193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 800/1615] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:21 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:22.062378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.073847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:22.123512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 816/1616] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:21 2021] PUT /identity/v3/projects/c960590f10854697bd6d178b738e8c36/users/0d4d44a32929468782603f5acead061d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:22.128626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.131752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5632c-7fd8-43d7-bba5-32c543894ca2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.400273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.402061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.402061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.406021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c45f0f-4dbf-4e81-9463-081cda1e1dc6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.408980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.409791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.414339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.426059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.426762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.427214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.427302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.428034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.448522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.494590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 817/1617] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:22 2021] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:22.495459 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.519850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b2e47-b7ac-4d84-a9f6-8ec8792efa2f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.534540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.536050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.536670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.537194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] PATH_INFO: `/v3/projects/c960590f10854697bd6d178b738e8c36/users/0d4d44a32929468782603f5acead061d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.540143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c960590f10854697bd6d178b738e8c36, user_id=0d4d44a32929468782603f5acead061d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.543891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc33c76-6131-4ad9-9f78-0247eb5b6125 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.557575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 818/1618] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:22 2021] PUT /identity/v3/projects/c960590f10854697bd6d178b738e8c36/users/0d4d44a32929468782603f5acead061d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:22.624924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.626348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.627793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 801/1619] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:22 2021] POST /identity/v3/projects => generated 405 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:22.632372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.632806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.691958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] MFA Rules not processed for user `0d4d44a32929468782603f5acead061d`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:22.694948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:22.787550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e36c-919a-4be0-b2eb-d30af9e918d5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.793663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.794663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.795688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.796805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.798263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.807252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.859639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 819/1620] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:22 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:22.861099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.875479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ca5f-8f72-42a3-9352-5f2d1cbea55d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.882411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.883531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.883708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.884137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] PATH_INFO: `/v3/users/7646937c928b4f2ba2973afb479c33d3` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.886529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7646937c928b4f2ba2973afb479c33d3)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.887619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: WARNING py.warnings [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 03:39:22.887619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: warnings.warn(msg) Aug 10 03:39:22.887619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: Aug 10 03:39:22.889324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:22.958539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 802/1621] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:22 2021] POST /identity/v3/users => generated 309 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:22.962565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:22.977647 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aa59b-622d-4e29-a144-9eeae7d927a4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:22.982913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:22.983873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:22.984304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:22.984755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:22.985710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:22.987906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:23.006946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 803/1622] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:22 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:23.011881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:23.028227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86443131-ec2b-47a5-bb2c-d5798a5dcd7c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:23.034273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:23.035214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:23.035604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:23.036142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] PATH_INFO: `/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639/users/e54dec5017a94546970a763cb3ecce19/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:23.061421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc3e38ae2645f0a4cd7eb3bdef0639, user_id=e54dec5017a94546970a763cb3ecce19, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:23.065045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:23.150331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 804/1623] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:23 2021] PUT /identity/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639/users/e54dec5017a94546970a763cb3ecce19/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:23.153444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:23.267369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370ac0-03fc-4cc0-8ffe-15fe7ebfd538 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:23.267988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7646937c928b4f2ba2973afb479c33d3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:23.281828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:23.285290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:23.285772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:23.286980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:23.288843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:23.293399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:23.331425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 805/1624] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:23 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:23.336546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:23.348886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7646937c928b4f2ba2973afb479c33d3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:23.358707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346c07-0729-4537-91b1-488dd3b16f38 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:23.367476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:23.368471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:23.368754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:23.369035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] PATH_INFO: `/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639/users/e54dec5017a94546970a763cb3ecce19/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:23.371572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bc3e38ae2645f0a4cd7eb3bdef0639, user_id=e54dec5017a94546970a763cb3ecce19, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:23.374208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea0046-e8a2-4935-af44-2c5b049337e8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:23.391507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 806/1625] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:23 2021] PUT /identity/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639/users/e54dec5017a94546970a763cb3ecce19/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:23.433180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7646937c928b4f2ba2973afb479c33d3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:23.433868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7646937c928b4f2ba2973afb479c33d3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:23.437341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7646937c928b4f2ba2973afb479c33d3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:23.472734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 820/1626] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:22 2021] DELETE /identity/v3/users/7646937c928b4f2ba2973afb479c33d3 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:23.475640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1cf5d-ff44-4d23-9874-e77b76423277 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:23.476631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1cf5d-ff44-4d23-9874-e77b76423277 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:23.476925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1cf5d-ff44-4d23-9874-e77b76423277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:23.510439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c4a1cf5d-ff44-4d23-9874-e77b76423277 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:23.511845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c4a1cf5d-ff44-4d23-9874-e77b76423277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:23.734417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 807/1627] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:23.770300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:23.772364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:23.906931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc686-1d6c-4b4c-b678-08d8ffa8d97e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:23.915173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:23.915955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:23.916552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:23.916552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:23.945455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:23.945455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:23.993087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 821/1628] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:24.087137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:24.087467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:24.087718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:24.107620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:24.109532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:24.182973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 808/1629] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:39:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:24.957225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:24.959356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:25.040998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbdfa7-9412-4da5-a1c6-527f8c23253f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:25.046929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:25.047908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:25.048431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:25.048858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:25.058784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:25.065516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:25.071152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 822/1630] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:39:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:39:26.060610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:26.062114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:26.085254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63633ca6-fdf1-40cf-b588-fcc13e5d814d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:26.090618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:26.098368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:26.098368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:26.098368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] PATH_INFO: `/v3/projects/ebb39df793f046399bb5538fb4b05158` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:26.099812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb39df793f046399bb5538fb4b05158)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:26.102362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:26.357376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb39df793f046399bb5538fb4b05158', 'request_id': 'req-742ca013-84f4-40d7-a76d-a2209df4ffc2'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:26.364551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb39df793f046399bb5538fb4b05158', 'request_id': 'req-742ca013-84f4-40d7-a76d-a2209df4ffc2'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:26.464786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb39df793f046399bb5538fb4b05158', 'request_id': 'req-742ca013-84f4-40d7-a76d-a2209df4ffc2'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:26.482584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] The token cache is being invalidate because project ebb39df793f046399bb5538fb4b05158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:26.483312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:26.493285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-742ca013-84f4-40d7-a76d-a2209df4ffc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:26.496811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 809/1631] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:26 2021] DELETE /identity/v3/projects/ebb39df793f046399bb5538fb4b05158 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:26.501009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:26.517606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbded-d86f-4bf7-a920-fe3b3df40b02 service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:26.668918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:26.669826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:26.670113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:26.670394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] PATH_INFO: `/v3/users/0d4d44a32929468782603f5acead061d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:26.672336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4d44a32929468782603f5acead061d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:26.674324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:27.346509 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4d44a32929468782603f5acead061d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:27.395457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4d44a32929468782603f5acead061d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:27.488135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4d44a32929468782603f5acead061d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:27.488802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4d44a32929468782603f5acead061d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:27.489424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a29b8996-8930-49f5-98cb-d7f21324a165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4d44a32929468782603f5acead061d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:27.519211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 823/1632] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:26 2021] DELETE /identity/v3/users/0d4d44a32929468782603f5acead061d => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:27.540725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:27.541320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:27.541320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:27.618134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] MFA Rules not processed for user `e54dec5017a94546970a763cb3ecce19`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:27.632342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:27.904769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 810/1633] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:27 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db8b83-3641-44fa-a505-c91cfff45191 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db8b83-3641-44fa-a505-c91cfff45191 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db8b83-3641-44fa-a505-c91cfff45191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-37db8b83-3641-44fa-a505-c91cfff45191 None None] MFA Rules not processed for user `84e7b0c8858f4616ad809fb025ffa9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-37db8b83-3641-44fa-a505-c91cfff45191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:28.517414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 824/1634] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:28 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:28.521405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:28.521405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:28.522887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:28.522887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:28.522887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:28.581554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:28.599821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:28.621787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfea83-04ce-4c02-a536-08fa06d78c85 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:28.632643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:28.633510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:28.633879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:28.634226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:28.660919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:28.662599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:28.692707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 811/1635] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:28 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:28.761661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 825/1636] 10.222.0.63 () {58 vars in 1016 bytes} [Tue Aug 10 03:39:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:28.790481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:28.792072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:28.834462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadc0-e131-4929-8adf-659b0749bc92 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:28.841460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:28.847389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:28.848129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:28.848722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:28.858597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:28.860829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6389f-e54e-47fc-ad86-fa1c0a36b5d0 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:28.894952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 812/1637] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:29.531630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:29.533590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:29.812431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d8b8-1199-4e7d-9aec-ac69e596dd0f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:29.818444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:29.819564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:29.820146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:29.820601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] PATH_INFO: `/v3/projects/c960590f10854697bd6d178b738e8c36` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:29.823000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c960590f10854697bd6d178b738e8c36)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:29.825571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:30.060379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c960590f10854697bd6d178b738e8c36', 'request_id': 'req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:30.081085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c960590f10854697bd6d178b738e8c36', 'request_id': 'req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:30.098130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c960590f10854697bd6d178b738e8c36', 'request_id': 'req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:30.261703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] The token cache is being invalidate because project c960590f10854697bd6d178b738e8c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:30.262597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:30.265557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cb4e3bc9-8e98-44f4-8bf5-bb1389317f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:30.273013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 826/1638] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:29 2021] DELETE /identity/v3/projects/c960590f10854697bd6d178b738e8c36 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:30.279601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:30.280318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:30.280318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:30.348076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:30.349392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:30.545424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 813/1639] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:30.546949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690033-db83-4005-9615-e50c63720e07 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:30.547771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690033-db83-4005-9615-e50c63720e07 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:30.548257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690033-db83-4005-9615-e50c63720e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:30.595465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-28690033-db83-4005-9615-e50c63720e07 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:30.597198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-28690033-db83-4005-9615-e50c63720e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:30.614479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 827/1640] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:30.619196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:30.643114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17eac4-30cf-4b1c-9ee8-e8367ae1b17f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:30.660978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:30.669339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:30.670395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:30.670919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:30.673399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:30.673762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:30.678799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:30.716277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 814/1641] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:39:30.720245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690033-db83-4005-9615-e50c63720e07 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:30.740501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690033-db83-4005-9615-e50c63720e07 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:30.754741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:30.755534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:30.755839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:30.756350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:30.757386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:30.761592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:31.006172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 828/1642] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:30 2021] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:31.008485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:31.046805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4de67-5ea8-4d43-ad23-8610c1864c2a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:31.364225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:31.371507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:31.371507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:31.371507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:31.371507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:31.371507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:31.560753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 815/1643] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:31 2021] POST /identity/v3/users => generated 294 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:31.561324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:31.588770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75a38-66a1-4b77-9a9f-f506d32f04c6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:31.633075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:31.634001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:31.636324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:31.636730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:31.637938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:31.644283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:31.674830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 829/1644] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:31.679586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:31.695047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefcc6a-ad98-4820-abf5-69c31acbbd99 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:31.713616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:31.715027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:31.715605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:31.716729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:31.719932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:31.724026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd00697-6e8a-4d34-b591-b5a59cb7a310 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:31.757059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 816/1645] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:31 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:31.758636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:31.776687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ead02-5315-42b9-84b7-b2ffd9d7171f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:31.795333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:31.796698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:31.797104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:31.797400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] PATH_INFO: `/v3/projects/1e802adb5e73452fb9a2dfae1a2371a6/users/8eedd801f8fb4804b91d929f25fc9445/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:31.831546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e802adb5e73452fb9a2dfae1a2371a6, user_id=8eedd801f8fb4804b91d929f25fc9445, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:31.835943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:31.950660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 830/1646] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:31 2021] PUT /identity/v3/projects/1e802adb5e73452fb9a2dfae1a2371a6/users/8eedd801f8fb4804b91d929f25fc9445/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:31.960544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:31.960829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:31.961121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:32.026899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] MFA Rules not processed for user `8eedd801f8fb4804b91d929f25fc9445`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:32.031420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:32.183833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:32.184520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 817/1647] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:31 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:32.338082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489a0d-bae8-429e-b34e-1f1f236fd000 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:32.347869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:32.348605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:32.351861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:32.351861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:32.351861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:32.352167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebfd59-3734-43e8-b769-e6ea1738af35 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:32.489511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:32.490349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 831/1648] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:32 2021] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:32.543917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eca35d-abf2-4e14-a6d7-f4f4bd1a660a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:32.821467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:32.825519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:32.825920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:32.826083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:32.826807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:32.838997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:32.884746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390163c-99fd-4197-995c-43900f98772f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:32.885236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390163c-99fd-4197-995c-43900f98772f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:32.885406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390163c-99fd-4197-995c-43900f98772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:32.965065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 818/1649] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:32 2021] POST /identity/v3/users => generated 294 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:32.974441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:32.983299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2390163c-99fd-4197-995c-43900f98772f None None] MFA Rules not processed for user `f4e6c08307964f198aa7efc7961aa09f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:32.985432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2390163c-99fd-4197-995c-43900f98772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:33.015142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ddcd3-52fd-4705-aca0-a3852e832b45 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:33.034735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:33.035614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.036035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.039858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.039858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:33.039858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:33.098046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 819/1650] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:32 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:33.101303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:33.146383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d296e-2bd0-4c53-9eaa-2ed4e5d50955 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:33.179532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:33.180247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.180538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.180816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.181563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:33.183431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:33.197004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 832/1651] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:33.205480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.205480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.205480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.255277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] MFA Rules not processed for user `f4e6c08307964f198aa7efc7961aa09f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:33.256806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:33.263878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 820/1652] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:33 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:33.267995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:33.307732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 833/1653] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:33.324687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08066acf-8514-4e45-bc46-f65906908c75 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:33.341782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:33.344734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:33.353134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:33.371570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.372246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.372748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] PATH_INFO: `/v3/projects/c102f0e53f2649adae20221d212e2b3f/users/cbc99a8d620a4c11a75507becef028f8/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.422707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c102f0e53f2649adae20221d212e2b3f, user_id=cbc99a8d620a4c11a75507becef028f8, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:33.426051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c9887b-35e8-46cb-9390-a53eea9f70d6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:33.609796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac994-460c-4f1b-9afc-51e0443789ab None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:33.636819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:33.637655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.637942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.638222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.664318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 821/1654] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:33 2021] PUT /identity/v3/projects/c102f0e53f2649adae20221d212e2b3f/users/cbc99a8d620a4c11a75507becef028f8/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:33.668851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c810f-10b9-4319-92e6-cee0301995ec None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:33.669206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c810f-10b9-4319-92e6-cee0301995ec None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:33.669503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c810f-10b9-4319-92e6-cee0301995ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:33.689357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:33.693738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4debad2-31c4-46e9-95fb-9a5218621311 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:33.742423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 834/1655] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:33 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:33.790594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9a6c810f-10b9-4319-92e6-cee0301995ec None None] MFA Rules not processed for user `cbc99a8d620a4c11a75507becef028f8`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:33.791972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9a6c810f-10b9-4319-92e6-cee0301995ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:34.006136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f750a-9528-43c2-b582-8ac02921c1f4 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:34.007419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f750a-9528-43c2-b582-8ac02921c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:34.008736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f750a-9528-43c2-b582-8ac02921c1f4 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:34.012572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 835/1656] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:39:34 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:34.021636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 822/1657] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:33 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:34.027064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f750a-9528-43c2-b582-8ac02921c1f4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:34.075678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01934-d81a-4474-96a6-698874006291 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:34.076448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01934-d81a-4474-96a6-698874006291 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:34.076931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab01934-d81a-4474-96a6-698874006291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:34.149189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-aab01934-d81a-4474-96a6-698874006291 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:34.153209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-aab01934-d81a-4474-96a6-698874006291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:34.271359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f750a-9528-43c2-b582-8ac02921c1f4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:34.288496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:34.289653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:34.290167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:34.290639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:34.291533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:34.293704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:34.361727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 823/1658] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:39:34 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:34.449156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 836/1659] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:34 2021] POST /identity/v3/projects => generated 385 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:34.450081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01934-d81a-4474-96a6-698874006291 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:34.467785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab01934-d81a-4474-96a6-698874006291 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:34.736901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:34.736901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:34.736901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:34.736901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:34.737782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:34.737782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:35.442891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:35.442891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:35.442891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730833e9-a6e0-466e-9331-83f0e4ee90b8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:35.447250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:35.447250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:35.447250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:35.447250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:35.450757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:35.450757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:35.450757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 837/1660] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:36.499089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 824/1661] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:34 2021] POST /identity/v3/users => generated 299 bytes in 2049 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:36.503346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:36.515435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccce0d-6cde-4149-8d9e-474b05ae1e48 service nova] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:36.520792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:36.526231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:36.526231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:36.526231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:36.526231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:36.526231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:36.535271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 838/1662] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:36.547959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:36.584065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf28d16-786f-4225-80fb-42aad8ae66b8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:36.601411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:36.604169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:36.605034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:36.606088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:36.612668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:36.613222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] PATH_INFO: `/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad/users/83f3c014f84142409597d609d3133558/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:36.636699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721fbd-d1d6-4f64-ab50-38f7a0ba3b17 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:36.658181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:36.659882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:36.662692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:36.665577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] PATH_INFO: `/v3/users/05318ccc5ddf4a9b93f278e26a99c1db` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:36.670209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05318ccc5ddf4a9b93f278e26a99c1db)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:36.679594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:36.683911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2913837c5847e0a1ff5678d8bc98ad, user_id=83f3c014f84142409597d609d3133558, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:36.687625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:36.825671 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 825/1663] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:36 2021] PUT /identity/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad/users/83f3c014f84142409597d609d3133558/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:36.830582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:36.833495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:37.092054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8a32f-eb0c-4ab5-af4b-ac8701bbc0c4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:37.102220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:37.103129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:37.103657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:37.103657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] PATH_INFO: `/v3/users/d07e39a420aa44dfb1a652eeead2a12b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:37.104985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07e39a420aa44dfb1a652eeead2a12b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:37.126733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:37.213253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05318ccc5ddf4a9b93f278e26a99c1db'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.237832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05318ccc5ddf4a9b93f278e26a99c1db'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.614591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05318ccc5ddf4a9b93f278e26a99c1db'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.616815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05318ccc5ddf4a9b93f278e26a99c1db'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.618458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05318ccc5ddf4a9b93f278e26a99c1db'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.645716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 839/1664] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:36 2021] DELETE /identity/v3/users/05318ccc5ddf4a9b93f278e26a99c1db => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:37.646829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:37.650097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:37.803627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3423-ff23-429e-89ff-32083f9b2eb1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:37.826387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:37.827199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:37.827492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:37.827773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:37.828547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:37.829444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07e39a420aa44dfb1a652eeead2a12b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.830384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07e39a420aa44dfb1a652eeead2a12b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.831371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07e39a420aa44dfb1a652eeead2a12b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.837212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be822d-d87a-4245-9297-301931283285 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:37.842711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07e39a420aa44dfb1a652eeead2a12b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.872393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1ba41be4-2340-49d5-90b9-635f766d7215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07e39a420aa44dfb1a652eeead2a12b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:37.873164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 840/1665] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:37 2021] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:37.878788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:37.881004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:37.881314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:37.932308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] MFA Rules not processed for user `f4e6c08307964f198aa7efc7961aa09f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:37.939085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:37.968063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 826/1666] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:36 2021] DELETE /identity/v3/users/d07e39a420aa44dfb1a652eeead2a12b => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:37.968063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50731-a572-4294-98da-5687076588a1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:37.968063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50731-a572-4294-98da-5687076588a1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:37.968063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50731-a572-4294-98da-5687076588a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:38.028275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-42b50731-a572-4294-98da-5687076588a1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:38.040592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-42b50731-a572-4294-98da-5687076588a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:38.071366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 841/1667] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:38.073365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:38.075457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:38.121192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13924b5-8eb6-4e8a-b085-1a319fb9dd20 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:38.277726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 827/1668] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:38.279096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:38.279384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:38.279686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:38.294504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:38.299928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:38.300434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:38.300895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] PATH_INFO: `/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad/users/83f3c014f84142409597d609d3133558/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:38.305537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2913837c5847e0a1ff5678d8bc98ad, user_id=83f3c014f84142409597d609d3133558, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:38.316317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:38.350758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 842/1669] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:38 2021] PUT /identity/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad/users/83f3c014f84142409597d609d3133558/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:38.360446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:38.368778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:38.409108 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] MFA Rules not processed for user `e2a2db05b54e45fba8475e7949a61d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:38.414784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:38.543998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482e8b1-aca2-41ac-a01c-239617b11d27 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:38.548954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:38.549923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:38.550447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:38.551818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:38.646874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:38.648925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de2ee-35fb-4b5f-81f6-24bc114009af service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:38.672911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 843/1670] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:38.674899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:38.675190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:38.675469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:38.686531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 828/1671] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:38 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:38.725889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] MFA Rules not processed for user `83f3c014f84142409597d609d3133558`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:38.744111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:38.900002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 844/1672] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:38 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:38.913701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:38.915294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:39.110186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5dda9-543c-45f9-9b55-11c61a39fa5f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:39.130256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:39.131134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:39.131428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:39.132640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:39.162779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:39.169704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:39.192000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 829/1673] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:38 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:39.506545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:39.510401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:39.719149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc1a9d-6771-46fb-84f3-4ed6a29a22bc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:39.726956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:39.727843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:39.728186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:39.728629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:39.741448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:39.744405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:39.757669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 845/1674] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:39 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:40.439709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:40.442651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:40.471544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637d4f0-49ef-47b6-906e-11ff8a8e6801 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:40.492124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:40.493209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:40.493575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:40.493931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] PATH_INFO: `/v3/projects/4b3175ba28ab4593b82d519d68b922f9` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:40.495677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3175ba28ab4593b82d519d68b922f9)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:40.510536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:40.830666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3175ba28ab4593b82d519d68b922f9', 'request_id': 'req-971e9065-67d2-4245-8c6d-b0d2a5949c5a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:40.862164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3175ba28ab4593b82d519d68b922f9', 'request_id': 'req-971e9065-67d2-4245-8c6d-b0d2a5949c5a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:40.966359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:40.968730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:41.002164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ea58-ee80-435f-993c-6b7fa90a2057 service nova] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:41.048222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3175ba28ab4593b82d519d68b922f9', 'request_id': 'req-971e9065-67d2-4245-8c6d-b0d2a5949c5a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.096285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] The token cache is being invalidate because project 4b3175ba28ab4593b82d519d68b922f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:41.096794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.098914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.103122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 830/1675] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:40 2021] DELETE /identity/v3/projects/4b3175ba28ab4593b82d519d68b922f9 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:41.107539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:41.112271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:41.179772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:41.182383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:41.182889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:41.183352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] PATH_INFO: `/v3/projects/95b081479da94713968106a7f24f0a9f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:41.193444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b081479da94713968106a7f24f0a9f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:41.211707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:41.276854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e9065-67d2-4245-8c6d-b0d2a5949c5a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:41.283897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:41.285130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:41.285628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:41.286867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] PATH_INFO: `/v3/users/e54dec5017a94546970a763cb3ecce19` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:41.288958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54dec5017a94546970a763cb3ecce19)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:41.291438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:41.866503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b081479da94713968106a7f24f0a9f', 'request_id': 'req-505c3f07-86a2-41db-93eb-230fc83343d0'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.870059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54dec5017a94546970a763cb3ecce19'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.881109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54dec5017a94546970a763cb3ecce19'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.881109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54dec5017a94546970a763cb3ecce19'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.888926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b081479da94713968106a7f24f0a9f', 'request_id': 'req-505c3f07-86a2-41db-93eb-230fc83343d0'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.900930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54dec5017a94546970a763cb3ecce19'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.905850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b081479da94713968106a7f24f0a9f', 'request_id': 'req-505c3f07-86a2-41db-93eb-230fc83343d0'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:41.921885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54dec5017a94546970a763cb3ecce19'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.070193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] The token cache is being invalidate because project 95b081479da94713968106a7f24f0a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:42.071130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.075113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.077778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 846/1676] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:40 2021] DELETE /identity/v3/projects/95b081479da94713968106a7f24f0a9f => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:42.080649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:42.092382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:42.190154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c3f07-86a2-41db-93eb-230fc83343d0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:42.197337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:42.198161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:42.198517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:42.198926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:42.201014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:42.219440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 831/1677] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:41 2021] DELETE /identity/v3/users/e54dec5017a94546970a763cb3ecce19 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:42.223574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:42.225144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:42.354277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:42.357876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:42.387516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 847/1678] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:42 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:42.431194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09649-69ae-4ea7-8dd3-989a6bd6bfb1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:42.446569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:42.447475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:42.447763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:42.448047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] PATH_INFO: `/v3/users/45f338927864470091d0c28a07339696` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:42.449379 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f338927864470091d0c28a07339696)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:42.451310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:42.821444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f338927864470091d0c28a07339696'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.822403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f338927864470091d0c28a07339696'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.823282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f338927864470091d0c28a07339696'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.830424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f338927864470091d0c28a07339696'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.843619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9d51ae89-d522-4b51-bb07-bb414b168e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f338927864470091d0c28a07339696'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:42.909761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:42.910496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:43.043362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 832/1679] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:42 2021] DELETE /identity/v3/users/45f338927864470091d0c28a07339696 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:43.063961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae9654-5ec9-44d7-bb19-6b3dda977172 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:43.229961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:43.231354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:43.231820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:43.232791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] PATH_INFO: `/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:43.238682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4bc3e38ae2645f0a4cd7eb3bdef0639)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:43.245904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:43.662340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4bc3e38ae2645f0a4cd7eb3bdef0639', 'request_id': 'req-2983a550-5baa-4da7-9add-19383734d52d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:43.671950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4bc3e38ae2645f0a4cd7eb3bdef0639', 'request_id': 'req-2983a550-5baa-4da7-9add-19383734d52d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:43.686378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4bc3e38ae2645f0a4cd7eb3bdef0639', 'request_id': 'req-2983a550-5baa-4da7-9add-19383734d52d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:43.817610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] The token cache is being invalidate because project b4bc3e38ae2645f0a4cd7eb3bdef0639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:43.817774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:43.822165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2983a550-5baa-4da7-9add-19383734d52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:43.825454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 848/1680] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:42 2021] DELETE /identity/v3/projects/b4bc3e38ae2645f0a4cd7eb3bdef0639 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:43.831719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961529f7-54df-4487-93b1-4482275f775c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:43.832009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961529f7-54df-4487-93b1-4482275f775c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:43.832472 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961529f7-54df-4487-93b1-4482275f775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:43.883939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-961529f7-54df-4487-93b1-4482275f775c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:43.885402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-961529f7-54df-4487-93b1-4482275f775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:43.904401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:43.904872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:43.905342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:43.950491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] MFA Rules not processed for user `84e7b0c8858f4616ad809fb025ffa9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:43.953616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.068566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 833/1681] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:44.072687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.073189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.073717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.106626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 849/1682] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:43 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:44.135503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:44.136896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.150978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 834/1683] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:44.155267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.180579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650c70f-5dad-431f-98d5-9d82cab2f2cb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.188604 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.189296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.189637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.190399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.191469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:44.191469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.198121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.225630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 850/1684] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:44.229633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.245081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff18ca3-790a-4bf7-a834-329ba170c0f5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.261393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.262532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.263040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.263497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.271227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.271227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.285154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.287080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.311225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8510fa2-afa2-4991-abe5-8d3395c31d9d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.319657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.322353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.322723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.323125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] PATH_INFO: `/v3/projects/de5fd130bbd34b348ebe07259e19f3c8` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.324729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5fd130bbd34b348ebe07259e19f3c8)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.328129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.414781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 835/1685] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:44.419143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.529519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a164d19-376a-47a5-81f9-38542278252e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.549641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5fd130bbd34b348ebe07259e19f3c8', 'request_id': 'req-13445ec6-0d8f-4abd-836a-73211c62e71d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:44.566371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5fd130bbd34b348ebe07259e19f3c8', 'request_id': 'req-13445ec6-0d8f-4abd-836a-73211c62e71d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:44.581086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5fd130bbd34b348ebe07259e19f3c8', 'request_id': 'req-13445ec6-0d8f-4abd-836a-73211c62e71d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:44.636313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.637075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.637326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.637609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.638547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.640357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.801744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] The token cache is being invalidate because project de5fd130bbd34b348ebe07259e19f3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:44.802050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:44.802881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-13445ec6-0d8f-4abd-836a-73211c62e71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:44.819655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 851/1686] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:44 2021] DELETE /identity/v3/projects/de5fd130bbd34b348ebe07259e19f3c8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:44.821536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff14b-f080-4455-9a1d-9724109e1edf None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.821851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff14b-f080-4455-9a1d-9724109e1edf None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.822252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aff14b-f080-4455-9a1d-9724109e1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.848386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-89aff14b-f080-4455-9a1d-9724109e1edf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:44.849932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-89aff14b-f080-4455-9a1d-9724109e1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.864244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 852/1687] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:44.870648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.871224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.871980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.884046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 836/1688] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/users => generated 286 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:44.888430 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.890585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.901378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:44.903503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:44.909577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92f404-15ff-4b14-a80b-5e17e1eeec57 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.916634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.916910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.917311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.917723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 853/1689] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:44.918560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.919015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.919523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.922182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.931943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c0e2-f2e3-4f2a-a1dc-dc2719ef9635 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.940282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 837/1690] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:44 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:44.941564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.941812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.942992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.943467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.943922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.944931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:44.945494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.947830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.955451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042345f-3ff8-40a7-914d-fd2dc5d255c2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.961442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.962204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.962567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.962957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:44.967318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:44.967318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:44.968421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 854/1691] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:44.970022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.984960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 838/1692] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:44 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:44.986797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:44.987384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca732ad-d5fe-44c3-ad09-d6e451f8f51c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:44.997910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:44.998941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:44.999442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:44.999824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba60f07-0c3e-4e8e-9a93-d21f52be1360 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:45.000314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.002117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.004612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.021716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:45.024037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.025037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.025390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] PATH_INFO: `/v3/projects/22d3a09fd2ec4da0867b0c792a474b5b/users/adf7139489bf469fa2f669caa052cdb4/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.045912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d3a09fd2ec4da0867b0c792a474b5b, user_id=adf7139489bf469fa2f669caa052cdb4, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.049593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbe7e6-d9ce-48ae-830b-9b6b54e5fa5d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.155082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 855/1693] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:44 2021] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:45.155082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:45.212502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 839/1694] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:44 2021] PUT /identity/v3/projects/22d3a09fd2ec4da0867b0c792a474b5b/users/adf7139489bf469fa2f669caa052cdb4/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:45.246004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.246004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.246004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.263750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207692-722e-46db-a476-05ee32e62571 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:45.279082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] MFA Rules not processed for user `adf7139489bf469fa2f669caa052cdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:45.280465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:45.348003 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:45.367490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.367490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.367490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.367490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.367490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.384542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 840/1695] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:45 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:45.385345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:45.397363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f694-1a78-46df-8681-dd3fa32093f5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:45.403315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:45.403990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.404309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.404667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.405394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.407830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.799513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 841/1696] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:45 2021] POST /identity/v3/projects => generated 373 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:45.803377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 856/1697] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:45 2021] POST /identity/v3/users => generated 283 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:45.807112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:45.808421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:45.824420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087caf4-5d7e-41b2-be6e-0495f4c48410 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:45.937339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:45.937339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.937339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.937339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.938880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bbf-5c92-4063-af85-06d7cd589796 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:45.947812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.949499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.951051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:45.951632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:45.951924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:45.952220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:45.955866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:45.961643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:45.989978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 857/1698] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:45.997492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.013212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a288ff5-1c0e-40ab-90d5-a386097e6fd5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.019119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.019881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.020263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.020706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.021638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.023681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.063895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 858/1699] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:45 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:46.067651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.094442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 842/1700] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:45 2021] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:46.105461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8841b6-106e-42a2-95e1-1999eb597ea2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.105461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.105461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.105461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.106018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] PATH_INFO: `/v3/projects/cf96adc457a04273bc9586060f793e25/users/56d763d0b5ff400b9916c3e4c5d95960/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.106689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.122431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2c12f-036b-46cc-8269-27c49f2f7462 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.133702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf96adc457a04273bc9586060f793e25, user_id=56d763d0b5ff400b9916c3e4c5d95960, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.136486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.137071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.137361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.137643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.137887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69e56d-df7b-4e65-8bd9-310709d8ae20 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.138419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.140046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.157653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 843/1701] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:46.159400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.171862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25bae4-9abc-4baa-bd56-4f19446c1cdb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.179547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.180487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.180773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.181053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] PATH_INFO: `/v3/projects/5372c5539a754b3d91986baa9a5fc064/users/14bc05a750a74641850dfd36ef437e39/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.198729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5372c5539a754b3d91986baa9a5fc064, user_id=14bc05a750a74641850dfd36ef437e39, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.202791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.250282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 859/1702] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:46 2021] PUT /identity/v3/projects/cf96adc457a04273bc9586060f793e25/users/56d763d0b5ff400b9916c3e4c5d95960/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:46.315086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.315086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.315086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.336053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 844/1703] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:46 2021] PUT /identity/v3/projects/5372c5539a754b3d91986baa9a5fc064/users/14bc05a750a74641850dfd36ef437e39/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:46.341296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.352470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] MFA Rules not processed for user `56d763d0b5ff400b9916c3e4c5d95960`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:46.354552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:46.459081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 860/1704] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:46.462009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.489678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fd824-03c2-46b7-a318-c4764c907152 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.503685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.504441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.505340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.505340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.505775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.507380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.531360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 845/1705] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:46 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:46.535814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.572551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c8b1-1540-4a6d-89d9-97ff387c8828 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.594923 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.605872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.605872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.605872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] PATH_INFO: `/v3/projects/5372c5539a754b3d91986baa9a5fc064/users/14bc05a750a74641850dfd36ef437e39/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.606302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591e53-a280-47f5-8f77-87153e402f1a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.608766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5372c5539a754b3d91986baa9a5fc064, user_id=14bc05a750a74641850dfd36ef437e39, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.616092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13266-26e8-4209-bbc4-2ab06de9ebd3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.616308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.617276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.617630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.617975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.619976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.622117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.640341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 846/1706] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:46 2021] PUT /identity/v3/projects/5372c5539a754b3d91986baa9a5fc064/users/14bc05a750a74641850dfd36ef437e39/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:46.653176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.657524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.657524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.686699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] MFA Rules not processed for user `14bc05a750a74641850dfd36ef437e39`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:46.688145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:46.746499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 861/1707] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:46 2021] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:46.750307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.828481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 847/1708] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:46 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:46.839638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:46.842825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:46.856495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b539-f893-440f-aac5-6181d856a512 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:46.863473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:46.878966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:46.878966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:46.878966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:46.878966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:46.878966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:46.952710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598c71-48ba-4b7b-8d7a-cbbf6e6c7ddd None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.000129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 862/1709] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:46 2021] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:47.004697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:47.009392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.010065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.010353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.010634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.015650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d441f0-e959-4cd1-b738-0bf97b01effe admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.021702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.022433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.022768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.023756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.024697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.026376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.042011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 863/1710] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:47.047690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:47.065061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e82869-206d-4759-8e30-44a5dc0a9858 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.081018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.081861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.082154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.082436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] PATH_INFO: `/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f/users/01807b02c5e4496ca307059421f5ed4d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.113864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2fd5aaf3794ffaba6dab3a3a45649f, user_id=01807b02c5e4496ca307059421f5ed4d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.119854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.132118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.133817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03466e-693c-495a-81c4-d14114a6d8c3 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.160965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 848/1711] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:46 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:47.252614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.255847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.255847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.272009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] MFA Rules not processed for user `e2a2db05b54e45fba8475e7949a61d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:47.273331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:47.313097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 864/1712] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:47 2021] PUT /identity/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f/users/01807b02c5e4496ca307059421f5ed4d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:47.315395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:47.348764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 849/1713] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:47 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:47.404258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18198c-6a8c-4ff2-baff-6adb084bafa8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.410865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.412331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.412681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.413140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.413959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.415861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25db8b-b32d-4ebe-9eaa-ed6f295040ea admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.428571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 865/1714] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:47 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:47.433143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:47.456733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32450399-2db2-49d3-8397-5dc719c2d2cf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.469885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.471755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.472638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.473276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] PATH_INFO: `/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f/users/01807b02c5e4496ca307059421f5ed4d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.480270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2fd5aaf3794ffaba6dab3a3a45649f, user_id=01807b02c5e4496ca307059421f5ed4d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.487612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.503100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 850/1715] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:47 2021] PUT /identity/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f/users/01807b02c5e4496ca307059421f5ed4d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:47.513747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb4f1-c2dd-40ff-aac9-7c66d933f53d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.514420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb4f1-c2dd-40ff-aac9-7c66d933f53d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.514842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb4f1-c2dd-40ff-aac9-7c66d933f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.554636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2dcfb4f1-c2dd-40ff-aac9-7c66d933f53d None None] MFA Rules not processed for user `01807b02c5e4496ca307059421f5ed4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:47.556139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2dcfb4f1-c2dd-40ff-aac9-7c66d933f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:47.645125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 866/1716] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:47 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:47.655978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:47.657725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:47.724832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075e483-24de-4285-88da-7904bdf42fff admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:47.751079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:47.751680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:47.751976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:47.752288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:47.778354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:47.779878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789d901-773f-4d0a-992a-814941968065 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:47.802097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 851/1717] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:47 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:48.166231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73b578-94b3-48ed-ad91-e029aaf3805e None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.171150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73b578-94b3-48ed-ad91-e029aaf3805e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.171150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73b578-94b3-48ed-ad91-e029aaf3805e None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:48.171150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 867/1718] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:39:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:48.179198 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.179718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.180249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:48.214383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73b578-94b3-48ed-ad91-e029aaf3805e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:48.223293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:48.230362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:48.230876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73b578-94b3-48ed-ad91-e029aaf3805e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:48.261051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:48.261866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.262055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.262557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:48.445706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:48.447407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:48.468075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 868/1719] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:48 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:39:48.495817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 852/1720] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:39:48 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:48.565044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:48.717192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59a2c2-077b-4f6d-8770-a7ac2a8d80bf service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:48.733721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:48.735218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:48.743684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:48.745534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.745829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.746111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] PATH_INFO: `/v3/users/adf7139489bf469fa2f669caa052cdb4` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:48.747961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf7139489bf469fa2f669caa052cdb4)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:48.749948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:48.761889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc9bc-6930-49e1-b385-57085b3ee9e6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:48.765674 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:48.767195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.767493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.767776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:48.778360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:48.780173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:48.791516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 853/1721] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:39:48.971231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:48.985162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51025917-1787-437b-b5bc-1e13029911f1 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:48.994033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:48.994702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:48.994986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:48.995260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.002714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:49.029327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf7139489bf469fa2f669caa052cdb4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:49.077782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf7139489bf469fa2f669caa052cdb4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:49.130058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:49.131829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25d889-6915-4bbc-8f11-d75ae7f0e8ef service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:49.144123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 854/1722] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:48 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:39:49.145204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3983e-70d0-4a05-972a-711797619222 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:49.145677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3983e-70d0-4a05-972a-711797619222 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:49.146126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3983e-70d0-4a05-972a-711797619222 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.148083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 855/1723] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:39:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:39:49.203014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf7139489bf469fa2f669caa052cdb4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:49.213243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf7139489bf469fa2f669caa052cdb4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:49.213243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf7139489bf469fa2f669caa052cdb4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:49.229754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 869/1724] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:48 2021] DELETE /identity/v3/users/adf7139489bf469fa2f669caa052cdb4 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:49.234377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4568-6460-4c38-8176-f7c5d6f7c059 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:49.234698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4568-6460-4c38-8176-f7c5d6f7c059 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:49.234984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4568-6460-4c38-8176-f7c5d6f7c059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.262253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-16bd4568-6460-4c38-8176-f7c5d6f7c059 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:49.263822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-16bd4568-6460-4c38-8176-f7c5d6f7c059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:49.359300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 856/1725] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:49.368684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:49.370398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:49.412458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:49.412964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:49.413488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.446072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:49.448434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:49.452728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a398469-66dd-4a3b-ace9-797ff660e351 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:49.458514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:49.459285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:49.459487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:49.459820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.491114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:49.493522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:49.522750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 870/1726] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:39:49.590652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 857/1727] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:39:49 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:49.679260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:49.681686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:49.702022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61473d0f-fc87-4620-99e8-8bbc89deab57 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:49.708626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:49.709670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:49.710125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:49.710676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:49.721552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:49.724035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:49.737812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 871/1728] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:50.892407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:50.896549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:50.917650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfa8d-efa7-42f9-8ce0-4314798e0265 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:50.923423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:50.924568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:50.925095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:50.925295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] PATH_INFO: `/v3/projects/22d3a09fd2ec4da0867b0c792a474b5b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:50.926631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d3a09fd2ec4da0867b0c792a474b5b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:50.928646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:51.154372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d3a09fd2ec4da0867b0c792a474b5b', 'request_id': 'req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.161695 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d3a09fd2ec4da0867b0c792a474b5b', 'request_id': 'req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.332941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d3a09fd2ec4da0867b0c792a474b5b', 'request_id': 'req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.346261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] The token cache is being invalidate because project 22d3a09fd2ec4da0867b0c792a474b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:51.346656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.347448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.349586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 858/1729] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:50 2021] DELETE /identity/v3/projects/22d3a09fd2ec4da0867b0c792a474b5b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:51.353539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:51.367476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60084b6c-6dee-436a-952f-554f1ddfda6d service nova] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:51.434610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:51.435849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:51.436389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:51.436738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] PATH_INFO: `/v3/users/14bc05a750a74641850dfd36ef437e39` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:51.438104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bc05a750a74641850dfd36ef437e39)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:51.440838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:51.793681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bc05a750a74641850dfd36ef437e39'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.806159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bc05a750a74641850dfd36ef437e39'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.973182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bc05a750a74641850dfd36ef437e39'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.973909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bc05a750a74641850dfd36ef437e39'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.974546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bc05a750a74641850dfd36ef437e39'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:51.988800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 872/1730] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:51 2021] DELETE /identity/v3/users/14bc05a750a74641850dfd36ef437e39 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:52.638742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:52.641087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:52.654446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2844dc-4f90-4ec1-ad06-f07ff4e45838 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:52.719341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:52.720769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:52.721225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:52.721514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] PATH_INFO: `/v3/projects/5372c5539a754b3d91986baa9a5fc064` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:52.722764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5372c5539a754b3d91986baa9a5fc064)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:52.723525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:52.724925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:52.727196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:52.744846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0110fe-e667-4159-9fc6-3d10a6fd2a48 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:52.749784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:52.750951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:52.751233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:52.751508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] PATH_INFO: `/v3/users/56d763d0b5ff400b9916c3e4c5d95960` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:52.752794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d763d0b5ff400b9916c3e4c5d95960)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:52.754798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:53.065655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5372c5539a754b3d91986baa9a5fc064', 'request_id': 'req-36fd4bca-197b-4707-9dfe-598b42d55699'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.071887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d763d0b5ff400b9916c3e4c5d95960'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.073628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5372c5539a754b3d91986baa9a5fc064', 'request_id': 'req-36fd4bca-197b-4707-9dfe-598b42d55699'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.095792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d763d0b5ff400b9916c3e4c5d95960'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.213040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5372c5539a754b3d91986baa9a5fc064', 'request_id': 'req-36fd4bca-197b-4707-9dfe-598b42d55699'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.233076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] The token cache is being invalidate because project 5372c5539a754b3d91986baa9a5fc064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:53.235663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.238991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-36fd4bca-197b-4707-9dfe-598b42d55699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.241960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 859/1731] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:52 2021] DELETE /identity/v3/projects/5372c5539a754b3d91986baa9a5fc064 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:53.247795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.248093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.248402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.297427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:53.301214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:53.310080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d763d0b5ff400b9916c3e4c5d95960'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.310733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d763d0b5ff400b9916c3e4c5d95960'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.311360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1009b4b4-dd89-4f23-97ec-685f1643c68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d763d0b5ff400b9916c3e4c5d95960'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:53.331393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 873/1732] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:52 2021] DELETE /identity/v3/users/56d763d0b5ff400b9916c3e4c5d95960 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:53.335750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25d9f-e36c-4654-a24b-5123eb387442 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.337180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25d9f-e36c-4654-a24b-5123eb387442 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.337670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e25d9f-e36c-4654-a24b-5123eb387442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.360619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c9e25d9f-e36c-4654-a24b-5123eb387442 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:53.362612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c9e25d9f-e36c-4654-a24b-5123eb387442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:53.463769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 874/1733] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:53.464728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 860/1734] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:53.471119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.471304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.471652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.484813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:53.488670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:53.515011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:53.517685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:53.547158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 875/1735] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:53.554959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:53.583411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf3386-b7c1-4318-8640-e9c8009a0abf None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:53.604313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:53.604924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.605212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.605493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.606236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:53.606550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:53.608501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:53.628080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d2d5-20b8-476e-a68b-8c688206d521 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:53.634707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 876/1736] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:39:53.638462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:53.654372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312ee4f-0626-4a5f-906a-e8b4934cceea admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:53.664782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:53.665905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.666388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.666673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.669024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:53.671981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:53.701080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:53.702481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.702992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.703453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.714776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:53.716817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:53.728153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 861/1737] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:53.782784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 877/1738] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:53 2021] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:53.783688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:53.795054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2648aa-b94a-4f08-89f6-e1a54c3e3a29 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:53.875335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:53.876482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:53.876973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:53.877466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:53.878412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:53.881077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.020030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 862/1739] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:53 2021] POST /identity/v3/users => generated 284 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:54.028387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.037572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349eb5-e8ea-464b-88d9-6842ecf66e96 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.050372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.056920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.056920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.056920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.056920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.066684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.104618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 878/1740] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:54.109070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.128128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4641-a348-49e4-9bc3-6dbae7c7e1c3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.146845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.147926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.148307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.148659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.149559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.152236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7654b6-1042-4429-8800-1728d496286c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.177506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 863/1741] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:54 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:54.177678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.191841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0dfc67-79e5-4e45-9c7e-eaef16df0d46 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.213502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.214407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.214846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.223309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] PATH_INFO: `/v3/projects/000c3861b5374168aaa4b8c095e4f637/users/d002fc257c894f4bb9a6df4b9f10ca7e/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.245200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000c3861b5374168aaa4b8c095e4f637, user_id=d002fc257c894f4bb9a6df4b9f10ca7e, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.247978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.378242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 879/1742] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:54 2021] PUT /identity/v3/projects/000c3861b5374168aaa4b8c095e4f637/users/d002fc257c894f4bb9a6df4b9f10ca7e/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:54.381442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.381739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.382516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.428070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] MFA Rules not processed for user `d002fc257c894f4bb9a6df4b9f10ca7e`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:54.429376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:54.542404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 864/1743] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:54 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:54.546677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.624261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce67c14-aeea-4877-ab85-e217bb7ee5f3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.630001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.634169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.634169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.634169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.634169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.635357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.700527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.703523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:54.740163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305aefd-7d30-4787-9261-71657101bde4 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.745964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.747279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.747717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.748140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] PATH_INFO: `/v3/projects/cf96adc457a04273bc9586060f793e25` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.749976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf96adc457a04273bc9586060f793e25)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.754739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.841386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 880/1744] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:54 2021] POST /identity/v3/projects => generated 369 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:39:54.842401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:54.914391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a73c5e-2d06-4f03-a3aa-1075939b73c1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:54.919153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:54.919859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:54.920130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:54.920446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:54.921136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:54.923265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:54.975827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf96adc457a04273bc9586060f793e25', 'request_id': 'req-6c2161d0-e335-4288-997a-6e10c199d62d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:54.982231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf96adc457a04273bc9586060f793e25', 'request_id': 'req-6c2161d0-e335-4288-997a-6e10c199d62d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.094888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 881/1745] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:54 2021] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:55.098706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.128731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90fa42-bbdb-4fb7-a751-d4dd245e51bd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.161658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf96adc457a04273bc9586060f793e25', 'request_id': 'req-6c2161d0-e335-4288-997a-6e10c199d62d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.169446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.170149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.170435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.170725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.171485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.173249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.178417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] The token cache is being invalidate because project cf96adc457a04273bc9586060f793e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:55.178825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.179896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.185743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 882/1747] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:55 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:55.186284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 865/1747] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:54 2021] DELETE /identity/v3/projects/cf96adc457a04273bc9586060f793e25 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:55.187334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.191794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.192238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:55.193444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:55.206354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a050-933f-49f7-9383-d6fac44227b1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.207631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2161d0-e335-4288-997a-6e10c199d62d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.211769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.212498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.212769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.213049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.213320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] PATH_INFO: `/v3/projects/d19738b7d71e42da8d8ac81d1d7358af/users/cf991ea1ce5942fdad1d21f9848c515a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.213420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.213641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.213919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] PATH_INFO: `/v3/users/01807b02c5e4496ca307059421f5ed4d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.215267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01807b02c5e4496ca307059421f5ed4d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.217284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.230482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19738b7d71e42da8d8ac81d1d7358af, user_id=cf991ea1ce5942fdad1d21f9848c515a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.234485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.418507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 866/1748] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:55 2021] PUT /identity/v3/projects/d19738b7d71e42da8d8ac81d1d7358af/users/cf991ea1ce5942fdad1d21f9848c515a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:55.422983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.541275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868e93-42e0-445e-ba19-4b6aaf37919f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.557213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01807b02c5e4496ca307059421f5ed4d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.564006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.571789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.571789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.571789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.571789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.571789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.585008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 867/1749] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:55 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:55.586739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.589437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01807b02c5e4496ca307059421f5ed4d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.605182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb4f8-de83-4fd2-9c0b-dd65704e5a60 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.615977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.617057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.617347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.617622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] PATH_INFO: `/v3/projects/d19738b7d71e42da8d8ac81d1d7358af/users/cf991ea1ce5942fdad1d21f9848c515a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.619609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19738b7d71e42da8d8ac81d1d7358af, user_id=cf991ea1ce5942fdad1d21f9848c515a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.622294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.640161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 868/1750] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:55 2021] PUT /identity/v3/projects/d19738b7d71e42da8d8ac81d1d7358af/users/cf991ea1ce5942fdad1d21f9848c515a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:55.640161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.640161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:55.709847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2f271-e827-4bdc-9c7f-294128ed1f51 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:55.715814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:55.717018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.717302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.717577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] PATH_INFO: `/v3/users/8eedd801f8fb4804b91d929f25fc9445` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.719075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eedd801f8fb4804b91d929f25fc9445)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:55.721568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:55.801598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01807b02c5e4496ca307059421f5ed4d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.802357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01807b02c5e4496ca307059421f5ed4d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.803103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a205dab2-7a6b-4a8e-bbcc-712cf252abe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01807b02c5e4496ca307059421f5ed4d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:55.818890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 883/1751] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:55 2021] DELETE /identity/v3/users/01807b02c5e4496ca307059421f5ed4d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:55.821074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:55.822196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:55.823176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:55.858824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] MFA Rules not processed for user `cf991ea1ce5942fdad1d21f9848c515a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:55.860957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:55.957376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 884/1752] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:55 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:55.968291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:55.973097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:56.007879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eedd801f8fb4804b91d929f25fc9445'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:56.008830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eedd801f8fb4804b91d929f25fc9445'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:56.009512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eedd801f8fb4804b91d929f25fc9445'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:56.019226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eedd801f8fb4804b91d929f25fc9445'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:56.033067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eedd801f8fb4804b91d929f25fc9445'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:56.045846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be52db-a529-4433-8b07-8ed1534a83d7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:56.049856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:56.050518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:56.050807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:56.051087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:56.052926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:56.065537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:56.066985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd2a5d-a015-40fc-bb85-dd4322a927be service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:56.077801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 885/1753] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:55 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:56.159517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 869/1754] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:55 2021] DELETE /identity/v3/users/8eedd801f8fb4804b91d929f25fc9445 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:56.170723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:56.171276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:56.171716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:56.202316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:56.203917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:56.282104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 886/1755] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:56.292360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:56.293800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:56.368400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbd15a-1659-428b-b535-82f56f458072 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:56.372637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:56.373298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:56.373590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:56.373869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:56.391566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:56.391566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:56.400298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 870/1756] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:56.809475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:56.813903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:56.841120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1874c-dd2b-40e2-a554-f472e6d058a4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:56.865076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:56.868896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:56.868896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:56.868896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] PATH_INFO: `/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:56.870685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2fd5aaf3794ffaba6dab3a3a45649f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:56.873250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:57.130307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2fd5aaf3794ffaba6dab3a3a45649f', 'request_id': 'req-a52dbf44-315b-4009-ba56-bb0deb7e5480'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.136995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2fd5aaf3794ffaba6dab3a3a45649f', 'request_id': 'req-a52dbf44-315b-4009-ba56-bb0deb7e5480'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.144137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2fd5aaf3794ffaba6dab3a3a45649f', 'request_id': 'req-a52dbf44-315b-4009-ba56-bb0deb7e5480'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.246892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:57.249174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:57.274124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a63e0-0299-4b99-a3f3-1926fa63d522 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:57.303575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] The token cache is being invalidate because project ef2fd5aaf3794ffaba6dab3a3a45649f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:57.303575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.303575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a52dbf44-315b-4009-ba56-bb0deb7e5480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.303575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 887/1757] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:56 2021] DELETE /identity/v3/projects/ef2fd5aaf3794ffaba6dab3a3a45649f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:57.303575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5058ab-e78e-4222-9f4a-ba9a6e32afab None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.304359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5058ab-e78e-4222-9f4a-ba9a6e32afab None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.304858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5058ab-e78e-4222-9f4a-ba9a6e32afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.323771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5b5058ab-e78e-4222-9f4a-ba9a6e32afab None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:57.325027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5b5058ab-e78e-4222-9f4a-ba9a6e32afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:57.349611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:57.350631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.351018 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.351362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] PATH_INFO: `/v3/projects/1e802adb5e73452fb9a2dfae1a2371a6` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.352978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e802adb5e73452fb9a2dfae1a2371a6)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:57.355324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:57.433957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 888/1758] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:57.442619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.442914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.443196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.461892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:57.463100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:57.471392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 889/1759] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:39:57.476768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:57.486679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3909-5873-4d05-9a1c-30e168ffc9a1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:57.501998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e802adb5e73452fb9a2dfae1a2371a6', 'request_id': 'req-8f263a94-e79b-49e1-949e-14c15b86938a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.509248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e802adb5e73452fb9a2dfae1a2371a6', 'request_id': 'req-8f263a94-e79b-49e1-949e-14c15b86938a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.552503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:57.553178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.553467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.553752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.554506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:39:57.554803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:57.556563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:57.568630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 890/1760] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:39:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:39:57.572976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:57.583552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc96ac-7b5f-4493-af16-de47cdaa1170 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:57.588435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:57.589078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.589366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.589651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.590337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:57.592365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:57.615353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e802adb5e73452fb9a2dfae1a2371a6', 'request_id': 'req-8f263a94-e79b-49e1-949e-14c15b86938a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.626716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] The token cache is being invalidate because project 1e802adb5e73452fb9a2dfae1a2371a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:57.627114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.627871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:57.629500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 871/1761] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:57 2021] DELETE /identity/v3/projects/1e802adb5e73452fb9a2dfae1a2371a6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:57.633344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:57.634732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:57.647131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263a94-e79b-49e1-949e-14c15b86938a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:57.652053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:57.652896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.653185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.653462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] PATH_INFO: `/v3/users/cbc99a8d620a4c11a75507becef028f8` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.654836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc99a8d620a4c11a75507becef028f8)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:57.657017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:57.817372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 891/1762] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:39:57 2021] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:57.821472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:57.823546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:57.889381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81a6f5-e898-4dc4-a035-e71a11bbc2e0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:57.894627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:57.895301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:57.895586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:57.895867 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:57.896606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:57.898511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:58.071173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 892/1763] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:39:57 2021] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:39:58.075289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:58.086358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc99a8d620a4c11a75507becef028f8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:58.086358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc99a8d620a4c11a75507becef028f8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:58.086358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc99a8d620a4c11a75507becef028f8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:58.086727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bd4b1-51cf-4ee7-ba27-0a0997a5f084 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:58.091468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:58.093360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:58.093360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:58.093360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:58.093648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc99a8d620a4c11a75507becef028f8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:58.093743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:58.095470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:58.104756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1b076140-9895-42d9-8136-54f5b8263151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc99a8d620a4c11a75507becef028f8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:58.111578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 893/1764] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:39:58.111578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:58.113144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:58.126800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476eda8-b2a7-4ebc-ba96-ab27c7a13bbc admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:58.131888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:58.132600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:58.132901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:58.133179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:58.133899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:58.135485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:58.149462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 894/1765] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:39:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:39:58.150468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:58.161534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bef385-706a-4db8-a871-07b1ceed249f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:58.166403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:58.167274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:58.167555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:58.167830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] PATH_INFO: `/v3/projects/6466ee4539e84646bd27e923d21d05f9/users/501d7ec1a2664ef0ae512b2a08f563fe/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:58.183077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6466ee4539e84646bd27e923d21d05f9, user_id=501d7ec1a2664ef0ae512b2a08f563fe, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:58.185757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:58.229740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 872/1766] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:57 2021] DELETE /identity/v3/users/cbc99a8d620a4c11a75507becef028f8 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:39:58.364425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 895/1767] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:39:58 2021] PUT /identity/v3/projects/6466ee4539e84646bd27e923d21d05f9/users/501d7ec1a2664ef0ae512b2a08f563fe/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:58.376259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:58.377555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:58.377854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:58.409198 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] MFA Rules not processed for user `501d7ec1a2664ef0ae512b2a08f563fe`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:39:58.410425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:58.485855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 873/1768] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:39:58 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:39:58.497415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:58.499236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:58.592278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951e9a-b7dc-498a-b698-0fb8ddc9e477 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:58.599778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:58.599778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:58.599778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:58.599778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:58.615761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:58.617554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:58.627658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 896/1769] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:39:58 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:39:59.137935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:59.145288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:39:59.215325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace44d-3139-403a-bcea-dfe2ad89f884 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:59.228903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:59.229799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:59.232597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:59.232597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] PATH_INFO: `/v3/projects/c102f0e53f2649adae20221d212e2b3f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:59.232597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c102f0e53f2649adae20221d212e2b3f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:59.233523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:39:59.372525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c102f0e53f2649adae20221d212e2b3f', 'request_id': 'req-85f844ff-fa11-4d5d-811f-daa67db81268'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:59.379040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c102f0e53f2649adae20221d212e2b3f', 'request_id': 'req-85f844ff-fa11-4d5d-811f-daa67db81268'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:59.481076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c102f0e53f2649adae20221d212e2b3f', 'request_id': 'req-85f844ff-fa11-4d5d-811f-daa67db81268'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:59.491935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] The token cache is being invalidate because project c102f0e53f2649adae20221d212e2b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:39:59.492253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:59.492877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:39:59.494438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 874/1770] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:39:59 2021] DELETE /identity/v3/projects/c102f0e53f2649adae20221d212e2b3f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:39:59.498361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:39:59.511512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010163a-4481-43cf-a65e-a2a7823f3299 service glance] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:39:59.581237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:39:59.582185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:39:59.582622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:39:59.583036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] PATH_INFO: `/v3/users/83f3c014f84142409597d609d3133558` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:39:59.584418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f3c014f84142409597d609d3133558)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:39:59.586746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:00.004615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f3c014f84142409597d609d3133558'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:00.016228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f3c014f84142409597d609d3133558'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:00.235607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f3c014f84142409597d609d3133558'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:00.236608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f3c014f84142409597d609d3133558'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:00.237250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ec8a4d6b-0126-464b-917a-be8a18ad5a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f3c014f84142409597d609d3133558'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:00.250466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 897/1771] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:39:59 2021] DELETE /identity/v3/users/83f3c014f84142409597d609d3133558 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:00.871295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:00.873362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:00.888863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f844ff-fa11-4d5d-811f-daa67db81268 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:01.008125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:01.008125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.008125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.008125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] PATH_INFO: `/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.009589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2913837c5847e0a1ff5678d8bc98ad)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:01.009589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:01.186179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2913837c5847e0a1ff5678d8bc98ad', 'request_id': 'req-143d3b6d-6847-463c-836d-fd713ac139a4'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.193960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2913837c5847e0a1ff5678d8bc98ad', 'request_id': 'req-143d3b6d-6847-463c-836d-fd713ac139a4'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.384359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2913837c5847e0a1ff5678d8bc98ad', 'request_id': 'req-143d3b6d-6847-463c-836d-fd713ac139a4'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.397097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] The token cache is being invalidate because project 6c2913837c5847e0a1ff5678d8bc98ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:01.397397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.398067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-143d3b6d-6847-463c-836d-fd713ac139a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.399702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 875/1772] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:00 2021] DELETE /identity/v3/projects/6c2913837c5847e0a1ff5678d8bc98ad => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:01.408273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.408782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.408878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.426670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:01.427883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:01.483105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 898/1773] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:01.518495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.518495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.518495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.518495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:01.518495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:01.524815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 876/1774] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:01.533712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:01.543162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720504d-9f34-4d13-8aec-9d98d1904646 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:01.548106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:01.548809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.549108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.549366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.550086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:01.550391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:01.551969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:01.566039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 899/1775] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:01.570324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:01.583760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:01.593163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4774e6c-c6b1-426e-a027-0008603b9fe7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:01.593300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:01.593396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:01.593396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.593396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.593396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.593761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:01.593903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:01.601204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90b72d-4899-442a-9d11-29ed79a03e3b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:01.606592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:01.607892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.608185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.608510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] PATH_INFO: `/v3/users/d002fc257c894f4bb9a6df4b9f10ca7e` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.609770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d002fc257c894f4bb9a6df4b9f10ca7e)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:01.612189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:01.782522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 877/1776] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:01 2021] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:01.785609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:01.854238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4a5be-e31a-4167-a0ce-eff5a1619fb9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:01.863141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:01.863897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:01.864262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:01.874051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:01.874051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:01.874051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:01.968341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd002fc257c894f4bb9a6df4b9f10ca7e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:01.981134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd002fc257c894f4bb9a6df4b9f10ca7e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:02.023633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 878/1777] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:01 2021] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:02.027888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.039122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57a139-242f-4eb0-8a10-ceb38b8f9f0f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.044380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.045318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.045723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.046096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.046898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.049179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.059669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 879/1778] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:02.064102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.077753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac4a-acf4-488c-a767-5096876fc9ac admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.082593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.089774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.089774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.089774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.089774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.089774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.097542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 880/1779] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:02.101836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.109335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd002fc257c894f4bb9a6df4b9f10ca7e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:02.110237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd002fc257c894f4bb9a6df4b9f10ca7e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:02.110946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d5a5f632-352c-4e18-9d79-879471c03849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd002fc257c894f4bb9a6df4b9f10ca7e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:02.118896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c0bd-1533-4824-825e-85a3949c38d7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.119542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.120707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.121097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.121375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] PATH_INFO: `/v3/projects/d85ca9de598949f2bda11b81a0b1f0cc/users/1766dc2b5da349069c9bfd76fb00fd07/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.126957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 900/1780] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:01 2021] DELETE /identity/v3/users/d002fc257c894f4bb9a6df4b9f10ca7e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:02.139287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85ca9de598949f2bda11b81a0b1f0cc, user_id=1766dc2b5da349069c9bfd76fb00fd07, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.141635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.143339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f4638-4e65-4a5a-ac3b-5c4b51253205 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.143756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.145899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.168503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:02.170075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:02.232493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 881/1781] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:02 2021] PUT /identity/v3/projects/d85ca9de598949f2bda11b81a0b1f0cc/users/1766dc2b5da349069c9bfd76fb00fd07/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:02.244453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.244746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.245081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.253370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 901/1782] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:02.260435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.261987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:02.296612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] MFA Rules not processed for user `1766dc2b5da349069c9bfd76fb00fd07`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:02.298360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:02.348014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79eb90-94e6-4d51-9512-f877ee4178b4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.380348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 882/1783] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:02 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:02.385019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.386384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:02.409947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.410746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.411113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.411609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.456483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6899-5841-4cb8-81e8-b916665780d0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.461103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.461755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.462034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.462313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.462990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.464915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.472877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.474338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.485674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 902/1784] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:02.613818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 883/1785] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:02 2021] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:02.614862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.625914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795b7c2-b4e2-4be2-9804-53765f32a82e service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.682317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.682986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.683273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.683548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.684244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.686201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.836497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 903/1786] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:02 2021] POST /identity/v3/users => generated 290 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:02.840458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.850677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df461e6f-1aab-468b-a2b9-13272f898829 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.855804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.856514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.856801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.857109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.857838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.859412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.874057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 884/1787] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:02.875331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.886142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260ed01-7356-4bd9-8d23-205bc35e97f3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.890996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.891799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.892088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.892616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.893353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.895167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.908248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 904/1788] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:02.912121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.924409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a915b-e5c0-4470-a1cb-57eabe055cd0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:02.929991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:02.930867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:02.931154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:02.931436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] PATH_INFO: `/v3/projects/2a50435f65284db391e3104a33d5a5f8/users/a0152599e2e9451a9cd7f1a422b3550b/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:02.946471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a50435f65284db391e3104a33d5a5f8, user_id=a0152599e2e9451a9cd7f1a422b3550b, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:02.949162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839a327-e41c-4fd3-8cd3-5aaf259c441c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:02.980031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:02.981837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:02.996079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 885/1789] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:02 2021] PUT /identity/v3/projects/2a50435f65284db391e3104a33d5a5f8/users/a0152599e2e9451a9cd7f1a422b3550b/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:02.999845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2769b-479a-42b1-a64c-ce9813a13e57 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.006689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.007658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.008026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.037871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] MFA Rules not processed for user `a0152599e2e9451a9cd7f1a422b3550b`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:03.039087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:03.055725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.056621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.056904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.057200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] PATH_INFO: `/v3/projects/000c3861b5374168aaa4b8c095e4f637` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.058421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000c3861b5374168aaa4b8c095e4f637)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.060535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.122148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 886/1790] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:03 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:03.127219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.137796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d67ad-06b9-414d-ada4-423856ed61f1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.143031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.143662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.143945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.144247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.145065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.147084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.177552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000c3861b5374168aaa4b8c095e4f637', 'request_id': 'req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.182836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000c3861b5374168aaa4b8c095e4f637', 'request_id': 'req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.188787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000c3861b5374168aaa4b8c095e4f637', 'request_id': 'req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.275118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 887/1791] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:03 2021] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:03.276268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.281146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] The token cache is being invalidate because project 000c3861b5374168aaa4b8c095e4f637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:03.281487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.282217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.284350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 905/1792] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:02 2021] DELETE /identity/v3/projects/000c3861b5374168aaa4b8c095e4f637 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:03.289650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.291075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:03.355939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c1d50-58ab-4d9b-8496-75f8f9c13bf2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.362734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.363559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.363870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.365197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.365197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.367030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.391577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be14e9-b0e8-4b0d-99ab-7ebfb908bcc6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.396496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.397363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.397643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.397913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] PATH_INFO: `/v3/users/cf991ea1ce5942fdad1d21f9848c515a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.399118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf991ea1ce5942fdad1d21f9848c515a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.401262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.505960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 888/1793] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:03 2021] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:03.513056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.516502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:03.530348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bc28-5419-40a1-b653-7c2cf998d77f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.536688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.547514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.547514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.547514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.547514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.547514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.551861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 889/1794] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:03.556275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.566205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b5539-3fa9-4e0c-9ca2-6e3212fbb4da admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.571057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.571935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.572247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.572539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] PATH_INFO: `/v3/projects/c9c7498b16194c0ea0830f0fed46d855/users/23409b100943479eac5cd10ef50fdd10/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.593829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c7498b16194c0ea0830f0fed46d855, user_id=23409b100943479eac5cd10ef50fdd10, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.593829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.625923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf991ea1ce5942fdad1d21f9848c515a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.637518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf991ea1ce5942fdad1d21f9848c515a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.715245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 890/1795] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:03 2021] PUT /identity/v3/projects/c9c7498b16194c0ea0830f0fed46d855/users/23409b100943479eac5cd10ef50fdd10/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:03.719113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.781099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc587f0-9465-4310-b78b-ee9d02da84dc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.787804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.788638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.788923 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.789205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.790160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.791737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.796328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf991ea1ce5942fdad1d21f9848c515a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.797004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf991ea1ce5942fdad1d21f9848c515a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.797846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-dac92ff1-a0fa-4843-ae4c-58f453fcbb0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf991ea1ce5942fdad1d21f9848c515a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:03.802596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 891/1796] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:03 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:03.809284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:03.809284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:03.817331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 906/1797] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:03 2021] DELETE /identity/v3/users/cf991ea1ce5942fdad1d21f9848c515a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:03.824364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d706-7522-4e64-ba61-e6f76e8d0469 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:03.881553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:03.882451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.882733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.883007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] PATH_INFO: `/v3/projects/c9c7498b16194c0ea0830f0fed46d855/users/23409b100943479eac5cd10ef50fdd10/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.884985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c7498b16194c0ea0830f0fed46d855, user_id=23409b100943479eac5cd10ef50fdd10, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:03.887598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:03.898422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 892/1798] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:03 2021] PUT /identity/v3/projects/c9c7498b16194c0ea0830f0fed46d855/users/23409b100943479eac5cd10ef50fdd10/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:03.910178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:03.913508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:03.913508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:03.941065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] MFA Rules not processed for user `23409b100943479eac5cd10ef50fdd10`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:03.942484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:04.016863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 907/1799] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:03 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:04.027920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:04.029750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:04.092972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8676-ba3b-4225-88ba-962c479a4ada admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:04.097943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:04.098260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:04.098614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:04.098983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:04.108437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:04.110006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:04.120842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 893/1800] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:04 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:04.336133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:04.337601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:04.349582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70a402-2afb-48b1-a62b-e11027fa9b1a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:04.391688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:04.391688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:04.391688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:04.391688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:04.391953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:04.393395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:04.395281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:04.428944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:04.430391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec3d4-0a30-4ea9-a445-ad3f76f29627 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:04.439761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 908/1801] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:04 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:04.472656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b6a1f-a406-4598-9da8-9f7de1afe587 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:04.478532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:04.482078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:04.482078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:04.482078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] PATH_INFO: `/v3/projects/d19738b7d71e42da8d8ac81d1d7358af` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:04.482413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19738b7d71e42da8d8ac81d1d7358af)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:04.484420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:04.767664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19738b7d71e42da8d8ac81d1d7358af', 'request_id': 'req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:04.773897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19738b7d71e42da8d8ac81d1d7358af', 'request_id': 'req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:04.943913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19738b7d71e42da8d8ac81d1d7358af', 'request_id': 'req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:04.955249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] The token cache is being invalidate because project d19738b7d71e42da8d8ac81d1d7358af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:04.955541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:04.956166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b23f7bf-0833-4f7f-8e8c-d47bb3e3b77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:04.957714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 894/1802] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:04 2021] DELETE /identity/v3/projects/d19738b7d71e42da8d8ac81d1d7358af => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:04.963506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:04.963947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:04.964069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:04.981152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:04.982352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:05.058852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 909/1803] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:05.067222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.067518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.067805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.087828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:05.089207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:05.097318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 895/1804] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:05.101488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.112342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254583dc-8258-4c2b-a81f-2b5cdbd33eb5 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.117225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.120538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.120538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.120538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.120538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:05.120538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.121139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.133230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 910/1805] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:05.137510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.146432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3520-eaf6-46dd-8a89-4b3deda67014 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.151072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.151721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.152006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.152325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.153006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.154889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.248460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 896/1806] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:05 2021] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:05.252838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.263295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd6a27-74ba-4e57-b2ea-3b6e4e63e775 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.319456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.320124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.320442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.320722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.321398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.323302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.406975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 911/1807] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:05 2021] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:05.411176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.421249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b0bb-368e-4a9a-8b40-2c4455f9cb1f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.426345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.426999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.427283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.427564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.428327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.429908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.440723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 897/1808] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:05.444570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.454303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2456d-f09f-494e-93c2-c96c54dec719 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.459002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.459653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.459938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.460240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.461054 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.462660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479668-dbf5-45a9-a074-c5b3630311c0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.472768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 912/1809] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:05.476845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.487277 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407c626-7d6b-4ea8-9586-3dfdb06c20c9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.491993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.492898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.493182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.496550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] PATH_INFO: `/v3/projects/9a61b7b46a144188861316ba337ea473/users/6f483885f47c4445ac5232251cf3c567/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.507506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a61b7b46a144188861316ba337ea473, user_id=6f483885f47c4445ac5232251cf3c567, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.510195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:05.653082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 898/1810] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:05 2021] PUT /identity/v3/projects/9a61b7b46a144188861316ba337ea473/users/6f483885f47c4445ac5232251cf3c567/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:05.666780 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.667077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.667573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.695924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] MFA Rules not processed for user `6f483885f47c4445ac5232251cf3c567`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:05.709257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:05.784702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 913/1811] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:05 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:05.786424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:05.861516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356439d-6154-448d-a716-2a914296a982 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:05.866600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:05.867428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:05.867956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:05.868504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:05.869171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:05.871393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.012008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 899/1812] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:05 2021] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:06.013861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.024443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6d2ab-f001-4bca-bb38-22a560dbeb66 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.104555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.105635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.106400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.106940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.108320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.111395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.227588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 914/1813] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:06 2021] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:06.228877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.239713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2b402-aac1-4007-b400-fcbc3ba5a9f6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.244475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.245295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.245651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.246033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.246859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.248575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.259711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 900/1814] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:06.264004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.274234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a7e7d-afbb-48e9-9f4b-be61c3733c70 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.279002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.279936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.280247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.280532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] PATH_INFO: `/v3/projects/8f7ef3f8372542c9abca85afa6d87972/users/50e8323fa237469c966c3fc0074ec78e/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.295841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7ef3f8372542c9abca85afa6d87972, user_id=50e8323fa237469c966c3fc0074ec78e, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.299103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.386513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 915/1815] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:06 2021] PUT /identity/v3/projects/8f7ef3f8372542c9abca85afa6d87972/users/50e8323fa237469c966c3fc0074ec78e/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:06.388731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.399745 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd86917-fa11-4cf3-8e43-94be0e0e6af5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.470059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.470751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.471094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.471376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.472115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.473827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbd78e-2fe0-4a6b-9787-6692e220b74d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.484771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 901/1816] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:06 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:06.489808 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.501154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee56de-af20-455a-9061-074350275ebf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.506205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.507351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.507791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.508284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] PATH_INFO: `/v3/projects/8f7ef3f8372542c9abca85afa6d87972/users/50e8323fa237469c966c3fc0074ec78e/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.510395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7ef3f8372542c9abca85afa6d87972, user_id=50e8323fa237469c966c3fc0074ec78e, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.513144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.538092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 916/1817] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:06 2021] PUT /identity/v3/projects/8f7ef3f8372542c9abca85afa6d87972/users/50e8323fa237469c966c3fc0074ec78e/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:06.559983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.559983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.559983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.589096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] MFA Rules not processed for user `50e8323fa237469c966c3fc0074ec78e`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:06.590481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:06.680627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 902/1818] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:06 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:06.697478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.699146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:06.757610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d4a9a-4ea5-4a21-bc23-10b02e5c56f1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.761926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.762149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.762437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.762807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.773311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.775015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff24c6-8055-45c7-a0ee-25326891233a service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:06.786851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 917/1819] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:06 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:06.889980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:06.961884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7f815-8b26-49a4-b0e1-bf6e017a5b0f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:06.973775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:06.974774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:06.975067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:06.975349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] PATH_INFO: `/v3/users/6f483885f47c4445ac5232251cf3c567` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:06.979093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f483885f47c4445ac5232251cf3c567)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:06.982815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:07.182822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f483885f47c4445ac5232251cf3c567'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:07.184300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f483885f47c4445ac5232251cf3c567'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:07.185076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f483885f47c4445ac5232251cf3c567'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:07.192968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f483885f47c4445ac5232251cf3c567'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:07.206166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f483885f47c4445ac5232251cf3c567'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:07.292666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 903/1820] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:06 2021] DELETE /identity/v3/users/6f483885f47c4445ac5232251cf3c567 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:07.298033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:07.298548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:07.298644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:07.315853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:07.317155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:07.378289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 918/1821] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:07.388390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:07.389820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:07.451158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a43f3-5fc6-4f81-879a-4ea67bc72f99 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:07.455544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:07.456222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:07.456524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:07.456808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:07.466663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:07.468139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:07.478739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 904/1822] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:08.125421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:08.127258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:08.152136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f745d-2ebc-4a18-9fc0-fa134294de9b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:08.157861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:08.164354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:08.165191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:08.165586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] PATH_INFO: `/v3/projects/9a61b7b46a144188861316ba337ea473` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:08.167655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a61b7b46a144188861316ba337ea473)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:08.184055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:08.383597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a61b7b46a144188861316ba337ea473', 'request_id': 'req-69698684-2767-4ba8-a8a6-c49172489b8f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.400995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a61b7b46a144188861316ba337ea473', 'request_id': 'req-69698684-2767-4ba8-a8a6-c49172489b8f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.410297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a61b7b46a144188861316ba337ea473', 'request_id': 'req-69698684-2767-4ba8-a8a6-c49172489b8f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.506548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] The token cache is being invalidate because project 9a61b7b46a144188861316ba337ea473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:08.506852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.507445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.513374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:08.522978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a73-9d83-4e3f-a96b-2373fdb2d843 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:08.523173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 919/1823] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:08 2021] DELETE /identity/v3/projects/9a61b7b46a144188861316ba337ea473 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:08.641207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:08.642477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:08.642729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:08.643082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] PATH_INFO: `/v3/users/50e8323fa237469c966c3fc0074ec78e` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:08.646100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e8323fa237469c966c3fc0074ec78e)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:08.648057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:08.959057 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e8323fa237469c966c3fc0074ec78e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.960376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e8323fa237469c966c3fc0074ec78e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.961171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e8323fa237469c966c3fc0074ec78e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.968764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e8323fa237469c966c3fc0074ec78e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:08.987454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2972f2de-7df3-4776-91f5-4161c2a764d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e8323fa237469c966c3fc0074ec78e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:09.107596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 905/1824] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:08 2021] DELETE /identity/v3/users/50e8323fa237469c966c3fc0074ec78e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:09.744017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:09.745537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:09.758689 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69698684-2767-4ba8-a8a6-c49172489b8f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:09.821884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:09.823041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:09.823499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:09.823846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] PATH_INFO: `/v3/projects/8f7ef3f8372542c9abca85afa6d87972` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:09.825407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7ef3f8372542c9abca85afa6d87972)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:09.827918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:09.989768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7ef3f8372542c9abca85afa6d87972', 'request_id': 'req-b050ae31-e5b7-45c0-9363-5f18901ad58a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:09.995701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7ef3f8372542c9abca85afa6d87972', 'request_id': 'req-b050ae31-e5b7-45c0-9363-5f18901ad58a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:10.002577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7ef3f8372542c9abca85afa6d87972', 'request_id': 'req-b050ae31-e5b7-45c0-9363-5f18901ad58a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:10.109679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] The token cache is being invalidate because project 8f7ef3f8372542c9abca85afa6d87972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:10.110281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:10.111229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b050ae31-e5b7-45c0-9363-5f18901ad58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:10.113031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 920/1825] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:09 2021] DELETE /identity/v3/projects/8f7ef3f8372542c9abca85afa6d87972 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:10.121920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.122869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.123314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.142495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:10.143691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:10.205613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 906/1826] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:10.214821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.215196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.215539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.234667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:10.236388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:10.247261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 921/1827] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:10.252317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.262446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432387-5d06-4f3f-81c3-4f63764d17c6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.267912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.268618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.268932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.270518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.270518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:10.270518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.271854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.284545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 907/1828] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:10.290190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.300113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a9fd9-d3c4-450b-93d7-3cf081c5c469 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.305242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.305946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.306234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.306510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.307217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.309169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.438851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 922/1829] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:10 2021] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:10.443527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.460102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920abb66-66f9-40ee-80ab-900d6c555498 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.556234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.557048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.557403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.557861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.558589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.564934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.613213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.615061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:10.640766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc2267-1572-4961-ac06-fc356ffc0a54 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.664921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.665845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.666855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.666855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] PATH_INFO: `/v3/users/1766dc2b5da349069c9bfd76fb00fd07` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.669856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1766dc2b5da349069c9bfd76fb00fd07)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.671675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.698798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 908/1830] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:10 2021] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:10.723240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.738173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f6fc-1133-4689-9d03-dc96b8109b5a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.751654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.752442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.752730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.753047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.753833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.755744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.768911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 909/1831] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:10 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:10.769942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.779718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b414a-3a7d-4a86-94da-fe31fbef0d44 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.785102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.785764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.786541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.786541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.787030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.788730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.800083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 910/1832] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:10.804240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:10.819779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b964f-e133-467d-8e84-1bb9402a8f1d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:10.819779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:10.820164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:10.820395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:10.820708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] PATH_INFO: `/v3/projects/1ae46a916b2e4308bbc8195bbd16ad81/users/7b07281bad5342f3950dfaf9f76dedef/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:10.835889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae46a916b2e4308bbc8195bbd16ad81, user_id=7b07281bad5342f3950dfaf9f76dedef, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:10.838574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800b1e4-bc10-40cb-829b-925392e4b79b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:10.996887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 911/1833] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:10 2021] PUT /identity/v3/projects/1ae46a916b2e4308bbc8195bbd16ad81/users/7b07281bad5342f3950dfaf9f76dedef/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:11.007894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:11.008371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:11.008648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:11.051892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] MFA Rules not processed for user `7b07281bad5342f3950dfaf9f76dedef`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:11.053258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:11.093460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1766dc2b5da349069c9bfd76fb00fd07'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:11.115712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1766dc2b5da349069c9bfd76fb00fd07'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:11.155635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 912/1834] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:11.163556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:11.165211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:11.207539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1766dc2b5da349069c9bfd76fb00fd07'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:11.207539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1766dc2b5da349069c9bfd76fb00fd07'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:11.207908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e80d41b2-739e-4ce7-92f8-5b5fe4ef485d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1766dc2b5da349069c9bfd76fb00fd07'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:11.232413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 923/1835] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:10 2021] DELETE /identity/v3/users/1766dc2b5da349069c9bfd76fb00fd07 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:11.237371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283639-8554-4009-bdce-087f0502a365 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:11.237783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283639-8554-4009-bdce-087f0502a365 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:11.238315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283639-8554-4009-bdce-087f0502a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:11.262775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7c16-f61a-4bc4-bf80-a77f475407b5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:11.269515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-47283639-8554-4009-bdce-087f0502a365 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:11.270829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-47283639-8554-4009-bdce-087f0502a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:11.325618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:11.326285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:11.326668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:11.327010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:11.329195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:11.364672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 924/1836] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:11.365759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283639-8554-4009-bdce-087f0502a365 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:11.367215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-47283639-8554-4009-bdce-087f0502a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:11.414667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:11.416656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7534be-26d6-45c5-b5a5-7dee18ec5b48 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:11.427699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 913/1837] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:11 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:11.442105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283639-8554-4009-bdce-087f0502a365 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:11.446078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:11.446735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:11.447018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:11.447348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:11.457242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:11.458702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:11.468862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 925/1838] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:11.971206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:11.972116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:11.972116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:12.021324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] MFA Rules not processed for user `cb4a0eaef1ba4df5a07bda5bef95dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:12.024648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:12.128561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 914/1839] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:12.177252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:12.178563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:12.195964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39ee2-f57c-4df3-b8e1-cb2b5296961f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:12.206595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:12.208162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:12.208524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:12.208833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] PATH_INFO: `/v3/projects/d85ca9de598949f2bda11b81a0b1f0cc` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:12.213037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85ca9de598949f2bda11b81a0b1f0cc)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:12.215269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:12.351197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85ca9de598949f2bda11b81a0b1f0cc', 'request_id': 'req-d7201c62-875f-4fe8-a5f9-605fb273d912'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.358740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85ca9de598949f2bda11b81a0b1f0cc', 'request_id': 'req-d7201c62-875f-4fe8-a5f9-605fb273d912'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.376931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85ca9de598949f2bda11b81a0b1f0cc', 'request_id': 'req-d7201c62-875f-4fe8-a5f9-605fb273d912'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.448008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] The token cache is being invalidate because project d85ca9de598949f2bda11b81a0b1f0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:12.452283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.452283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.452283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 926/1840] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:12 2021] DELETE /identity/v3/projects/d85ca9de598949f2bda11b81a0b1f0cc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:12.455441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:12.466938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f701ea4-d4a6-443e-b4fa-d812c8e1cfbd None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:12.527955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:12.528877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:12.529254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:12.529617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] PATH_INFO: `/v3/users/a0152599e2e9451a9cd7f1a422b3550b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:12.530892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0152599e2e9451a9cd7f1a422b3550b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:12.533422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:12.747515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0152599e2e9451a9cd7f1a422b3550b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.748372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0152599e2e9451a9cd7f1a422b3550b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.749097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0152599e2e9451a9cd7f1a422b3550b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.758999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0152599e2e9451a9cd7f1a422b3550b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.777828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0152599e2e9451a9cd7f1a422b3550b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:12.847242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 915/1841] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:12 2021] DELETE /identity/v3/users/a0152599e2e9451a9cd7f1a422b3550b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:13.657842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:13.659766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:13.678672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201c62-875f-4fe8-a5f9-605fb273d912 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:13.741483 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:13.742398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:13.742694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:13.743010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] PATH_INFO: `/v3/projects/2a50435f65284db391e3104a33d5a5f8` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:13.744113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a50435f65284db391e3104a33d5a5f8)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:13.746046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:13.997968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a50435f65284db391e3104a33d5a5f8', 'request_id': 'req-e1051279-e9e1-4093-9330-4d80c3ce9317'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.003954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a50435f65284db391e3104a33d5a5f8', 'request_id': 'req-e1051279-e9e1-4093-9330-4d80c3ce9317'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.010593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a50435f65284db391e3104a33d5a5f8', 'request_id': 'req-e1051279-e9e1-4093-9330-4d80c3ce9317'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.128606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] The token cache is being invalidate because project 2a50435f65284db391e3104a33d5a5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:14.128898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.129586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.131170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 927/1842] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:13 2021] DELETE /identity/v3/projects/2a50435f65284db391e3104a33d5a5f8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:14.135249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:14.136837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:14.149620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c80bc7-7110-42e9-9e2f-1c84c7dd3cde admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:14.212272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:14.213154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:14.213435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:14.213713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] PATH_INFO: `/v3/users/23409b100943479eac5cd10ef50fdd10` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:14.215030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=23409b100943479eac5cd10ef50fdd10)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:14.217044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:14.531866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23409b100943479eac5cd10ef50fdd10'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.533569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23409b100943479eac5cd10ef50fdd10'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.534465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23409b100943479eac5cd10ef50fdd10'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.545899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23409b100943479eac5cd10ef50fdd10'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.559250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9bb46d36-0e7a-4127-b41a-b7b10ec1fbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23409b100943479eac5cd10ef50fdd10'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:14.698074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 916/1843] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:14 2021] DELETE /identity/v3/users/23409b100943479eac5cd10ef50fdd10 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:15.228688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:15.229144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:15.242961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1051279-e9e1-4093-9330-4d80c3ce9317 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:15.302718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:15.303619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:15.303901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:15.307707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] PATH_INFO: `/v3/projects/c9c7498b16194c0ea0830f0fed46d855` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:15.307707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c7498b16194c0ea0830f0fed46d855)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:15.307707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:15.474206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c7498b16194c0ea0830f0fed46d855', 'request_id': 'req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:15.480306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c7498b16194c0ea0830f0fed46d855', 'request_id': 'req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:15.491058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c7498b16194c0ea0830f0fed46d855', 'request_id': 'req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:15.680508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] The token cache is being invalidate because project c9c7498b16194c0ea0830f0fed46d855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:15.680872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:15.681508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f9e0c19e-d626-4a90-8d22-aa4d4e556e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:15.683072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 928/1844] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:15 2021] DELETE /identity/v3/projects/c9c7498b16194c0ea0830f0fed46d855 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:15.690535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:15.691007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:15.691303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:15.711009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:15.711009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:15.774072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 917/1845] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:15.783216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:15.785530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:15.785530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:15.804129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:15.805464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:15.813598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 929/1846] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:15.818744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:15.832433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa965-ab5d-4fb3-865c-35ae48ffdca6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:15.837314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:15.837971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:15.838259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:15.838536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:15.839358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:15.839666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:15.841304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:15.853377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 918/1847] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:15.858027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:15.867431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364684e4-805e-48d5-9b50-3d907df3b7d1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:15.872493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:15.873148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:15.873434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:15.873708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:15.874427 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:15.876407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:15.998115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 930/1848] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:15 2021] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:16.003033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.012982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17205d-3fc8-43d6-bf84-251953b937a2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.069993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.070668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.070955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.071236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.071954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.073918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.162041 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 919/1849] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:16 2021] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:16.167168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.180832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c6de-9407-4921-ae5c-1012eb388976 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.186085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.186755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.187081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.187428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.188735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.190522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.204753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 931/1850] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:16 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:16.210016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.221645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401872a-b225-4260-b45c-9a55703a21e0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.228011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.228949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.229363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.229787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.236541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.236541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316909aa-4c2a-4c7b-9de5-c58294fdc9a6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.244320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 920/1851] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:16 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:16.249297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.259920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db3867-f53a-4378-aee1-092f759b5eae admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.267040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.267932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.268245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.270493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] PATH_INFO: `/v3/projects/cae81b138717422cbbfbfab48de86528/users/076c7b4c35264557a1c160ae356b8a5d/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.288501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae81b138717422cbbfbfab48de86528, user_id=076c7b4c35264557a1c160ae356b8a5d, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.291151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.413357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 932/1852] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:16 2021] PUT /identity/v3/projects/cae81b138717422cbbfbfab48de86528/users/076c7b4c35264557a1c160ae356b8a5d/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:16.425836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.426132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.426416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.458183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] MFA Rules not processed for user `076c7b4c35264557a1c160ae356b8a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:16.459707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:16.541555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 921/1853] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:16 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:16.555296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.579526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.581577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:16.635495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896872f-2bdb-4a62-b354-98c68bc3d5c1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.643338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.644321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.644615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.644898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.645652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.647627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.658267 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c65f67-643c-49f4-b029-2c17ab03b8b1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.663626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.664693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.665116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.665489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] PATH_INFO: `/v3/users/7b07281bad5342f3950dfaf9f76dedef` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.666999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b07281bad5342f3950dfaf9f76dedef)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.669061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.820501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 933/1854] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:16 2021] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:16.824269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:16.891928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2e8ed-2a6d-41f2-aead-9b49fb839d92 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:16.896792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:16.897468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:16.897755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:16.898067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:16.898750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:16.900711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:16.947168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b07281bad5342f3950dfaf9f76dedef'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:16.948235 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b07281bad5342f3950dfaf9f76dedef'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:16.949005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b07281bad5342f3950dfaf9f76dedef'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:16.956798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b07281bad5342f3950dfaf9f76dedef'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:16.971468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-538e10e1-da30-4468-b361-168d7d7a9997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b07281bad5342f3950dfaf9f76dedef'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:17.026192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 934/1855] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:16 2021] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:17.038269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.040594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:17.053526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 922/1856] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:16 2021] DELETE /identity/v3/users/7b07281bad5342f3950dfaf9f76dedef => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:17.059069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a4355-f03e-4210-8d75-a1e9a4e6812a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.062650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.063467 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.063750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.086295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:17.088266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:17.128615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.129556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.129987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.130439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.131312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.133777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.147292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 935/1857] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:17.151947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.161189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 923/1858] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:17.170960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831722c7-78dc-43bc-a669-7f69c08df4c0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.170960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.170960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.170960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.171321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] PATH_INFO: `/v3/projects/583759b57c754b82ba94bb3c16f4dae4/users/8c201a1e73334b9bbf226d55b4285007/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.178726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.180243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:17.186095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583759b57c754b82ba94bb3c16f4dae4, user_id=8c201a1e73334b9bbf226d55b4285007, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.189367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.237746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adbe72-aaea-4445-910e-6b9c18ce3d59 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.250111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.250111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.250111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.250111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.262646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.264092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.274362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 924/1859] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:17.321225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 936/1860] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:17 2021] PUT /identity/v3/projects/583759b57c754b82ba94bb3c16f4dae4/users/8c201a1e73334b9bbf226d55b4285007/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:17.330262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.339719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71236073-77d9-4559-b5b3-1142ea7e641a service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.424690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.425702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.426115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.426532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.427681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.430979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ccfcc-77f1-46f6-b21b-f8b71019b7ee admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.443658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 925/1861] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:17 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:17.447909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.467919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77160-650e-4b51-bb4a-a3ebe79cb363 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.473304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.474206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.474543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.474852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] PATH_INFO: `/v3/projects/583759b57c754b82ba94bb3c16f4dae4/users/8c201a1e73334b9bbf226d55b4285007/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.483801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=583759b57c754b82ba94bb3c16f4dae4, user_id=8c201a1e73334b9bbf226d55b4285007, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.483801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.492800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 937/1862] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:17 2021] PUT /identity/v3/projects/583759b57c754b82ba94bb3c16f4dae4/users/8c201a1e73334b9bbf226d55b4285007/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:17.503592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.503592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.503935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.531939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] MFA Rules not processed for user `8c201a1e73334b9bbf226d55b4285007`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:17.533333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:17.603980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 926/1863] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:17 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:17.617244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:17.619642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:17.694954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e37a-4a6f-4877-ac14-0fe0213e4e3c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:17.699919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:17.705259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:17.705259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:17.705259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:17.714979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:17.717164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:17.732300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 938/1864] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:17 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:17.985478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:18.002152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac4f51-ff5f-4b4b-8f33-ae56f6c9c4c8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:18.007037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:18.007917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:18.008490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:18.008930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:18.010949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:18.086406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:18.087857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c790e-6f3a-4589-9c27-b4a78a023b4a service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:18.100236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 927/1865] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:17 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:18.128979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:18.130805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:18.290132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc20299-1db1-4a46-bf8a-672a1b651a51 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:18.299804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:18.300997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:18.301830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:18.302267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] PATH_INFO: `/v3/projects/1ae46a916b2e4308bbc8195bbd16ad81` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:18.304358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae46a916b2e4308bbc8195bbd16ad81)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:18.308359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:18.586195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae46a916b2e4308bbc8195bbd16ad81', 'request_id': 'req-127d5b8c-acd2-4f12-b807-42b0a60ef507'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:18.594749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae46a916b2e4308bbc8195bbd16ad81', 'request_id': 'req-127d5b8c-acd2-4f12-b807-42b0a60ef507'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:18.603023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae46a916b2e4308bbc8195bbd16ad81', 'request_id': 'req-127d5b8c-acd2-4f12-b807-42b0a60ef507'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:18.949336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] The token cache is being invalidate because project 1ae46a916b2e4308bbc8195bbd16ad81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:18.949336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:18.949336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-127d5b8c-acd2-4f12-b807-42b0a60ef507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:18.949336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 939/1866] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:18 2021] DELETE /identity/v3/projects/1ae46a916b2e4308bbc8195bbd16ad81 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:18.957249 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:18.957686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:18.958160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:18.990626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:18.994042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:19.079456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 928/1867] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:19.093723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.094061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.094353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.118872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:19.120069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:19.128626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 940/1868] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:19.133586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.145315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8742a0-34c7-42e3-a78a-7f6f845ffe8d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.152285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.153437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.153911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.159184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.159184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:19.159184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.159184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.185965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 929/1869] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:19.190598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.207926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e06114-b09d-46ac-9e44-c6cd097d1fe1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.222959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.223718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.227837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.227837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.228491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.230499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.233812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.235626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:19.257490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4f8bb-a867-476e-97c1-2879cee2a2c9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.262225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.263091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.263374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.263653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] PATH_INFO: `/v3/users/09b063b3c1f344f5818b55f29b349571` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.264868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b063b3c1f344f5818b55f29b349571)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.267448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.503947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 941/1870] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:19 2021] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:19.512530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.575770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162a0b2-2883-43f0-ab18-6690108f1582 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.581125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.581947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.582252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.582687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.583486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.585498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.813278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b063b3c1f344f5818b55f29b349571'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:19.813278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b063b3c1f344f5818b55f29b349571'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:19.813278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b063b3c1f344f5818b55f29b349571'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:19.819915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b063b3c1f344f5818b55f29b349571'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:19.832543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d730a3d0-aa6a-4f75-a412-b711f78c1ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b063b3c1f344f5818b55f29b349571'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:19.879391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 942/1871] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:19 2021] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:19.881052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.883366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:19.896341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf61c0d-d20b-4c18-a454-460c685ed033 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.901052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.901738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.902002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.902278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.903027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.904689 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.917906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 943/1872] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:19 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:19.923376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.934038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a845307-94ba-4d4b-bb23-b365313fe1c3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.939990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.940848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.941333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.941814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:19.942830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:19.944592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:19.963612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 944/1873] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:19 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:19.967532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:19.978063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b1da-7932-45bc-af13-5172a01a919f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:19.983779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:19.984365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:19.985355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:19.985613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] PATH_INFO: `/v3/projects/179844eb84b845e88a99717f1e6b5aa1/users/44ed507019b6423c95ed6a6433a56646/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:20.002040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179844eb84b845e88a99717f1e6b5aa1, user_id=44ed507019b6423c95ed6a6433a56646, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:20.004694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:20.030390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 930/1874] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:19 2021] DELETE /identity/v3/users/09b063b3c1f344f5818b55f29b349571 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:20.225042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 945/1875] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:19 2021] PUT /identity/v3/projects/179844eb84b845e88a99717f1e6b5aa1/users/44ed507019b6423c95ed6a6433a56646/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:20.237116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:20.237413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:20.237694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:20.271764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] MFA Rules not processed for user `44ed507019b6423c95ed6a6433a56646`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:20.273058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:20.342984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 931/1876] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:20 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:20.347477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:20.354237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:20.355934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:20.441849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19214002-1e5a-4114-ab5c-ba9570685db7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:20.447373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:20.448222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:20.448617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:20.448969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:20.449734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:20.451833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:20.479911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0248e4-3868-4ba8-909c-6b637a6dc8f8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:20.491161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:20.492073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:20.492417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:20.492842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] PATH_INFO: `/v3/projects/02cb87684af34e389239670bfe0eb2af` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:20.494408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cb87684af34e389239670bfe0eb2af)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:20.496621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:20.741142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 946/1877] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:20 2021] POST /identity/v3/projects => generated 377 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:20.745251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:20.807925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fd1a0-3fab-4968-a7f4-e966d2031ff6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:20.813304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:20.814341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:20.814675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:20.814950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:20.815636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:20.817573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:20.842436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cb87684af34e389239670bfe0eb2af', 'request_id': 'req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:20.849310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cb87684af34e389239670bfe0eb2af', 'request_id': 'req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:21.137908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 947/1878] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:20 2021] POST /identity/v3/users => generated 289 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:21.141822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.151591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bba733-12cb-495a-9969-31535021a180 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.172788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cb87684af34e389239670bfe0eb2af', 'request_id': 'req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:21.186408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] The token cache is being invalidate because project 02cb87684af34e389239670bfe0eb2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:21.186929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:21.195567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f7a9508e-47b7-4c5a-a257-f0ffd39e72d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:21.195567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 932/1879] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:20 2021] DELETE /identity/v3/projects/02cb87684af34e389239670bfe0eb2af => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:21.197219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00573ac-a128-4808-99dd-6e2139c6d850 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.197509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00573ac-a128-4808-99dd-6e2139c6d850 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.197796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00573ac-a128-4808-99dd-6e2139c6d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.210076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.211072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.211433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.211802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.212873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.214567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.215894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e00573ac-a128-4808-99dd-6e2139c6d850 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:21.217169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e00573ac-a128-4808-99dd-6e2139c6d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:21.225311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 948/1880] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:21.225470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 933/1881] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:21.229259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.230968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:21.233143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.233431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.233708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.244842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219f154-a62b-4ff9-9326-3b4f145e70aa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.249717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.250460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.271720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.271720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.271720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.271957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:21.271957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:21.272103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.272188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 934/1882] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:21.272294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 949/1883] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:21.272851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.273393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.282946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54945f41-1f95-41ca-b815-37b56fcc4552 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.284598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669558b-2642-48a6-80a1-119612a520d9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.288071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.289042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.289326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.289605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] PATH_INFO: `/v3/projects/7c75fcdb60a844fcb8fa2f7d11cb8e49/users/8ebb3672574c45eabf8fb000ffcce1ad/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.290396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.291111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.291397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.291674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.292424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:21.293425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.294499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.305916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c75fcdb60a844fcb8fa2f7d11cb8e49, user_id=8ebb3672574c45eabf8fb000ffcce1ad, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.309050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 950/1884] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:21.312072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.313137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.323845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe3f6f-8ad6-4ca8-a1e8-f9040301add6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.328595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.329250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.329721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.329807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.330507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.332430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71f7db-be88-49dc-90ea-b66fd3524ca4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.499430 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 935/1885] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:21 2021] PUT /identity/v3/projects/7c75fcdb60a844fcb8fa2f7d11cb8e49/users/8ebb3672574c45eabf8fb000ffcce1ad/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:21.502513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 951/1886] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/projects => generated 407 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:21.506667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.510946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.511206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.511499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.575142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] MFA Rules not processed for user `8ebb3672574c45eabf8fb000ffcce1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:21.575142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:21.601335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03f025-72c1-46cd-bf17-375d81e32ed3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.637238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 952/1887] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:21.642265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.679476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.680149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.680465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.680741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.681425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.683380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.707948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dabc4-2715-4e7c-99e0-f74088c4bc77 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.712917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.713586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.713868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.714170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.714859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.716865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.924246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 936/1888] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/users => generated 304 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:21.924450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 953/1889] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:21.925730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.926822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:21.935557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418b5ba-b02c-4e22-8897-8e34c7719056 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.989398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74145164-92bf-490e-ac6d-84d7293c8016 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:21.992423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.993097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.993380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.993656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.994409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.994535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:21.995220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:21.995667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:21.995949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:21.996110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:21.996696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:21.998675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.006285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 937/1890] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:21 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:22.010437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.019741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231301-e021-4576-a9e6-37865762fad9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.024762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.025411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.025698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.025975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.026690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.028321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.038549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 938/1891] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:22.043996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.054445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d6d8-654c-43b3-8cb1-4b6056a426c0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.059353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.060259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.060548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.060964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] PATH_INFO: `/v3/projects/7f9cb6d74f3a4cd68ceb26a159406324/users/3aa31569fade4508b9ee8bea750f07a3/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.077416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9cb6d74f3a4cd68ceb26a159406324, user_id=3aa31569fade4508b9ee8bea750f07a3, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.080101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004935-d7b8-4d4f-82bf-8530e1a913b1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.149796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 954/1892] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:21 2021] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:22.153752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.164443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eac45-f3c7-4bb6-a977-5c1c6e4a8e8e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.169626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.170378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.170672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.170948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.171678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.173936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.184484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 955/1893] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:22.188477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.191533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 939/1894] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:22 2021] PUT /identity/v3/projects/7f9cb6d74f3a4cd68ceb26a159406324/users/3aa31569fade4508b9ee8bea750f07a3/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:22.199450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f2b8b-3c0a-4cfa-b943-e39579433f03 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.244763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.245056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.245378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.273749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] MFA Rules not processed for user `3aa31569fade4508b9ee8bea750f07a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:22.274618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.274966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:22.275516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.275796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.276070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] PATH_INFO: `/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0/users/8ec9ebfea3514252b9c756f7ebe5cc24/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.302505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b511c6dc7e94c4eb78afd89d79562a0, user_id=8ec9ebfea3514252b9c756f7ebe5cc24, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.305410 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.340163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 940/1895] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:22 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:22.345208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.355296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991968-14f1-435d-89dc-c5e3bd0f8761 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.360608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.361501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.361783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.362064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.362773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.364690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.441365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 956/1896] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:22 2021] PUT /identity/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0/users/8ec9ebfea3514252b9c756f7ebe5cc24/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:22.445547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.473282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 941/1897] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:22 2021] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:22.481010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.506274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01594a-c113-4799-880a-cb9478fe0436 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.542464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ac32a-179b-4231-81b6-9de0b2a4c154 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.549535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.549535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.549535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.549535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.549896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.551485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.561521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.562187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.562469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.562799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.563515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.565206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.575220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 957/1898] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:22.590039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.600219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62557-fe95-49c9-941b-8d3ea874dda2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.604785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.605625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.605908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.606182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] PATH_INFO: `/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0/users/8ec9ebfea3514252b9c756f7ebe5cc24/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.608100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b511c6dc7e94c4eb78afd89d79562a0, user_id=8ec9ebfea3514252b9c756f7ebe5cc24, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.611182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede7ed2-1656-4c23-a666-50c5b888fae4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.622141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 958/1899] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:22 2021] PUT /identity/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0/users/8ec9ebfea3514252b9c756f7ebe5cc24/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:22.638753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.639046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.639329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.667713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] MFA Rules not processed for user `8ec9ebfea3514252b9c756f7ebe5cc24`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:22.669024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:22.739237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 959/1900] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:22 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:22.749595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.751602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:22.778196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 942/1901] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:22 2021] POST /identity/v3/users => generated 311 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:22.787557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.798241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5829bf-c1b8-4a1c-929d-157d6132a45c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.810497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4d2ba-48bb-449c-aa10-2b3da4dc342d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.814592 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.815243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.819250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.819250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.819250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:22.883859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.884783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.885170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.885541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.886574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.888374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.889979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.892012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:22.900752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 943/1902] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:22 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:22.903439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 960/1903] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:22 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:22.904957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:22.916179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805d989-5c40-4793-bc62-472b7f077ed3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:22.921099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:22.922035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:22.922336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:22.922614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] PATH_INFO: `/v3/projects/6537e85b38584474bebf641ac6d1278d/users/6363701b6c7141b3bc0a8d46779f933f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:22.939295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6537e85b38584474bebf641ac6d1278d, user_id=6363701b6c7141b3bc0a8d46779f933f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:22.940589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:23.104558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 944/1904] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:22 2021] PUT /identity/v3/projects/6537e85b38584474bebf641ac6d1278d/users/6363701b6c7141b3bc0a8d46779f933f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:23.119347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:23.130791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbfe20-f77b-4f6a-a6a3-b34a48355060 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:23.184685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:23.185361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:23.185626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:23.185926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:23.186644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:23.188848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b997ff-cfbb-4db0-805b-8549853c529d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:23.198390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 961/1905] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:23 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:23.206777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:23.220246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720edebd-41f4-4c7c-8c60-eadd9936e7f2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:23.225335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:23.226861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:23.226861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:23.226861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] PATH_INFO: `/v3/projects/6537e85b38584474bebf641ac6d1278d/users/6363701b6c7141b3bc0a8d46779f933f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:23.228907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6537e85b38584474bebf641ac6d1278d, user_id=6363701b6c7141b3bc0a8d46779f933f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:23.231542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:23.243110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 945/1906] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:23 2021] PUT /identity/v3/projects/6537e85b38584474bebf641ac6d1278d/users/6363701b6c7141b3bc0a8d46779f933f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:23.253274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:23.253562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:23.253845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:23.282364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] MFA Rules not processed for user `6363701b6c7141b3bc0a8d46779f933f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:23.283599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:23.363437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 962/1907] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:23 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:23.399452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:23.401224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:23.458679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c13031-8679-44e4-a295-9f82cd563595 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:23.462399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:23.463046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:23.463335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:23.463615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:23.473146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:23.474679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:23.484462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 946/1908] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:23 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:24.264646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:24.274497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7499-07a3-495d-8d10-b6728b7f99d1 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:24.278261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:24.278916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:24.282391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:24.282391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:24.339493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:24.341159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:24.350603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 963/1909] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:24 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:26.399605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:26.409294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd609603-20b6-47b1-84a8-907b65739af1 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:26.413388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:26.414113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:26.414454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:26.414738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:26.470262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:26.471395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:26.480125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 947/1910] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:26 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:29.098298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:29.099919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:29.149036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:29.158795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d730-78c9-4aef-be29-b5404a6c5b8f service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:29.162772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:29.163419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:29.164000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:29.164000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:29.179554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4e7a2-2d02-4974-ac29-be3c4b639ab1 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:29.185956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:29.187417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:29.187737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:29.188021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] PATH_INFO: `/v3/users/076c7b4c35264557a1c160ae356b8a5d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:29.189440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=076c7b4c35264557a1c160ae356b8a5d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:29.191590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:29.232284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:29.233723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d2a65-d51b-48dc-b5e1-b1a7016b82ac service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:29.243474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 948/1911] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:29 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:29.482348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076c7b4c35264557a1c160ae356b8a5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:29.494857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076c7b4c35264557a1c160ae356b8a5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:29.686542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076c7b4c35264557a1c160ae356b8a5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:29.687153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076c7b4c35264557a1c160ae356b8a5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:29.687791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076c7b4c35264557a1c160ae356b8a5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:29.700537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 964/1912] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:29 2021] DELETE /identity/v3/users/076c7b4c35264557a1c160ae356b8a5d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:29.706477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:29.707114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:29.707684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:29.730431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:29.731777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:29.790936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 949/1913] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:29.818189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:29.819869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:29.877209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f2321-8afa-494b-98a4-09380ce75873 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:29.880790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:29.881473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:29.881754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:29.887846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:29.891258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:29.892892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:29.902333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 965/1914] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:30.693849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:30.695528 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:30.708453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22058f-c01e-4ea4-82f3-7a296de5f297 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:30.714028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:30.715091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:30.715469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:30.715844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] PATH_INFO: `/v3/projects/cae81b138717422cbbfbfab48de86528` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:30.717557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae81b138717422cbbfbfab48de86528)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:30.720507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:30.892691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae81b138717422cbbfbfab48de86528', 'request_id': 'req-34fa1072-86f4-4ce0-a0c8-43823af03de6'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:30.898827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae81b138717422cbbfbfab48de86528', 'request_id': 'req-34fa1072-86f4-4ce0-a0c8-43823af03de6'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.046456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae81b138717422cbbfbfab48de86528', 'request_id': 'req-34fa1072-86f4-4ce0-a0c8-43823af03de6'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.060931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] The token cache is being invalidate because project cae81b138717422cbbfbfab48de86528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:31.061462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.062107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.064224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 950/1915] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:30 2021] DELETE /identity/v3/projects/cae81b138717422cbbfbfab48de86528 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:31.068154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:31.081822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9964b1f-984c-4623-9a16-9bb570eb2a71 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:31.137352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:31.138231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:31.138516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:31.138797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] PATH_INFO: `/v3/users/8c201a1e73334b9bbf226d55b4285007` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:31.140053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c201a1e73334b9bbf226d55b4285007)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:31.142564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:31.363577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c201a1e73334b9bbf226d55b4285007'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.375864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c201a1e73334b9bbf226d55b4285007'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.514364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c201a1e73334b9bbf226d55b4285007'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.515017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c201a1e73334b9bbf226d55b4285007'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.515652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4b9e0964-9efc-4717-820a-0a8b8e103074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c201a1e73334b9bbf226d55b4285007'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:31.528269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 966/1916] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:31 2021] DELETE /identity/v3/users/8c201a1e73334b9bbf226d55b4285007 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:32.271583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:32.273314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:32.288075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1072-86f4-4ce0-a0c8-43823af03de6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:32.342393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:32.343278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:32.343561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:32.343879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] PATH_INFO: `/v3/projects/583759b57c754b82ba94bb3c16f4dae4` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:32.345668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] RBAC: Authorizing `identity:delete_project(project_id=583759b57c754b82ba94bb3c16f4dae4)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:32.347545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:32.561137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583759b57c754b82ba94bb3c16f4dae4', 'request_id': 'req-8e0f64ba-54a7-4167-89b0-e432f66a962e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:32.567282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583759b57c754b82ba94bb3c16f4dae4', 'request_id': 'req-8e0f64ba-54a7-4167-89b0-e432f66a962e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:32.769383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583759b57c754b82ba94bb3c16f4dae4', 'request_id': 'req-8e0f64ba-54a7-4167-89b0-e432f66a962e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:32.780902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] The token cache is being invalidate because project 583759b57c754b82ba94bb3c16f4dae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:32.781692 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:32.782407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e0f64ba-54a7-4167-89b0-e432f66a962e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:32.783952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 951/1917] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:32 2021] DELETE /identity/v3/projects/583759b57c754b82ba94bb3c16f4dae4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:32.789711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:32.790185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:32.790366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.071126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:33.071126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.125869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 967/1918] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:33.133690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.133989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.134273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.158785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:33.159324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.174085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.176089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 952/1919] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:33.177068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.178505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.191227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba657c5-7901-45ec-8e74-1a0a7c062d22 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.195013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140e25-33cd-4549-8a62-a10af3615f4e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.196534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.197433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.197780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.198062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] PATH_INFO: `/v3/users/501d7ec1a2664ef0ae512b2a08f563fe` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.199344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=501d7ec1a2664ef0ae512b2a08f563fe)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.200424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.201128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.201381 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.201516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.201747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.202855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:33.204025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.206273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.219677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 968/1920] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:33.231209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.242251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54278c-64df-4ba9-82fa-63d42c235841 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.247629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.248443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.248734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.249044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.249741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.252190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.448053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 969/1921] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:33 2021] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:33.453128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.524053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2de01-2825-47c1-9a54-5b05153f72bd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.530048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.530048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.530048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.530440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.530800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.532783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.603592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501d7ec1a2664ef0ae512b2a08f563fe'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:33.604319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501d7ec1a2664ef0ae512b2a08f563fe'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:33.605079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501d7ec1a2664ef0ae512b2a08f563fe'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:33.612823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501d7ec1a2664ef0ae512b2a08f563fe'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:33.625069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c0dfe875-5c6a-46a6-bd52-7571d4eefe9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501d7ec1a2664ef0ae512b2a08f563fe'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:33.710194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 970/1922] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:33 2021] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:33.720076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.720076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.727888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20f78-6e3a-4b8d-94df-34fa855270d1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.732719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.733375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.733662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.733942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.735181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.737047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.746577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 971/1923] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:33.750939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.755987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 953/1924] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:33 2021] DELETE /identity/v3/users/501d7ec1a2664ef0ae512b2a08f563fe => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:33.760506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a5c-17dd-4248-91a0-4fd48eda5629 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.766183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.766183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.766183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.778180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:33.779363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.816588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.817331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.817633 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.817910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.818662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.820430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.830658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 972/1925] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:33 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:33.834814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.837180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 954/1926] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:33.845195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326555f2-32b9-4b02-ad5e-781649486232 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.849461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:33.851074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.852165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:33.852376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.853376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.853376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] PATH_INFO: `/v3/projects/46fb8b2b63114fd68f07ec997a49a162/users/84491dcbe2d1410a8d7557538c91c204/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.873636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fb8b2b63114fd68f07ec997a49a162, user_id=84491dcbe2d1410a8d7557538c91c204, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.873636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.917874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca533649-bb08-4335-8c4b-47c57f14dc34 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:33.921521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:33.922209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:33.922493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:33.922766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:33.931778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:33.933336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4cd81-9024-41fe-a7d5-1abd2f5c3dc5 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:33.942984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 955/1927] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:34.001585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 973/1928] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:33 2021] PUT /identity/v3/projects/46fb8b2b63114fd68f07ec997a49a162/users/84491dcbe2d1410a8d7557538c91c204/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:34.007310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:34.007700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:34.008514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:34.027841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:34.029367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:34.096090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 956/1929] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:34.111233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:34.111332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:34.168898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7a215-d962-475e-9a5f-f223e0b37811 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:34.179690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:34.179690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:34.179690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:34.179690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:34.188860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:34.190380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b78f-aa98-4d71-9715-45facab74c93 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:34.200366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 974/1930] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:34.439151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:34.441996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:34.493151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac34923-a930-41ee-bc43-e45f71a9e9e6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:34.503874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:34.507530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:34.507530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:34.507530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] PATH_INFO: `/v3/projects/6466ee4539e84646bd27e923d21d05f9` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:34.510098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6466ee4539e84646bd27e923d21d05f9)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:34.515510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:34.845118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6466ee4539e84646bd27e923d21d05f9', 'request_id': 'req-6b698a78-8959-4dd2-bbc6-ab9ff073c736'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:34.860281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6466ee4539e84646bd27e923d21d05f9', 'request_id': 'req-6b698a78-8959-4dd2-bbc6-ab9ff073c736'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:34.972453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6466ee4539e84646bd27e923d21d05f9', 'request_id': 'req-6b698a78-8959-4dd2-bbc6-ab9ff073c736'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:34.983663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] The token cache is being invalidate because project 6466ee4539e84646bd27e923d21d05f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:34.983956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:34.984643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6b698a78-8959-4dd2-bbc6-ab9ff073c736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:34.986437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 957/1931] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:34 2021] DELETE /identity/v3/projects/6466ee4539e84646bd27e923d21d05f9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:34.992729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:34.993254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:34.993446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.011458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:35.012683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:35.074654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 975/1932] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:35.086759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.086759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.086759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.105202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:35.106992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:35.120725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 958/1933] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:35.125851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.160017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07571f8e-916f-44ec-b38f-f89d71308006 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.160017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.160017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.160017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.160489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.160489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:35.160489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.160489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.160489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 976/1934] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:35.163262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.173195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17b5cd-d5c8-4a22-b316-55ba798cc1c7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.178021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.178679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.178963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.179238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.179936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.181862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.346769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 959/1935] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:35 2021] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:35.352041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.368369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701b2ab-d940-4fc9-9846-fc62d57cc9d3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.421182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.422403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.422694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.422970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.423659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.425640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.564565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 977/1936] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:35 2021] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:35.568741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.580595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39a01-dd0f-4672-bbf8-5248bca2b850 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.586411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.587200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.587590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.587991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.588873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.590828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.602964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 960/1937] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:35.611034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.622136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88244d2-be6e-4916-9161-271d8160c271 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.627740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.627868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.628103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.628416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.629148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.631131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c3b51-94ab-47bc-8e7a-976d4522dff6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.643680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 978/1938] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:35.649247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:35.661202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244d1f3-091b-4d97-b8ea-89cce8307403 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:35.665925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:35.666803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:35.667088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:35.667366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] PATH_INFO: `/v3/projects/eb3d1d340d154f7c9929184b98414377/users/9e6d9822cef54884a77735f74c787260/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:35.691589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3d1d340d154f7c9929184b98414377, user_id=9e6d9822cef54884a77735f74c787260, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:35.694331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:35.995326 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 961/1939] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:35 2021] PUT /identity/v3/projects/eb3d1d340d154f7c9929184b98414377/users/9e6d9822cef54884a77735f74c787260/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:36.006795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d5bb1-752d-40fc-9af5-0072ff204670 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:36.007287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d5bb1-752d-40fc-9af5-0072ff204670 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:36.007386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d5bb1-752d-40fc-9af5-0072ff204670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:36.034726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-911d5bb1-752d-40fc-9af5-0072ff204670 None None] MFA Rules not processed for user `9e6d9822cef54884a77735f74c787260`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:36.035969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-911d5bb1-752d-40fc-9af5-0072ff204670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:36.100677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 979/1940] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:36 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:36.110510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:36.112451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:36.172850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221881e-f611-4693-b433-d57018bbd98d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:36.176456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:36.177103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:36.177386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:36.177663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:36.185707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:36.187133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:36.195749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 962/1941] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:36 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:36.382753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309353b2-e207-401f-9a7f-6dc42632901a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:36.383105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309353b2-e207-401f-9a7f-6dc42632901a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:36.383391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309353b2-e207-401f-9a7f-6dc42632901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:36.410201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-309353b2-e207-401f-9a7f-6dc42632901a None None] MFA Rules not processed for user `84491dcbe2d1410a8d7557538c91c204`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:36.411557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-309353b2-e207-401f-9a7f-6dc42632901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:36.477398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 980/1942] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:36 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:36.490393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:36.491819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:36.502813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff29f-9138-414a-b0eb-4b00e5d76555 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:36.506893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:36.507338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:36.507626 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:36.507902 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:36.516342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:36.517761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:36.526954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 963/1943] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:36 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:38.989531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd334-40bd-46ea-9e5c-be1b210f1367 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:38.990114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd334-40bd-46ea-9e5c-be1b210f1367 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:38.990114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfd334-40bd-46ea-9e5c-be1b210f1367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:39.008066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f1cfd334-40bd-46ea-9e5c-be1b210f1367 None None] MFA Rules not processed for user `cb4a0eaef1ba4df5a07bda5bef95dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:39.009324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f1cfd334-40bd-46ea-9e5c-be1b210f1367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:39.064968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 981/1944] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:38 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:39.285970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:39.288450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:39.379710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab723da-dfcd-4641-9b71-870dd86829ca None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:39.380864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab723da-dfcd-4641-9b71-870dd86829ca None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:39.381345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab723da-dfcd-4641-9b71-870dd86829ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:39.399468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93a7c-9c3b-4419-a773-a0a5daf086b1 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:39.405117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:39.406035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:39.406847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:39.407127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] PATH_INFO: `/v3/users/3aa31569fade4508b9ee8bea750f07a3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:39.408362 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bab723da-dfcd-4641-9b71-870dd86829ca None None] MFA Rules not processed for user `84491dcbe2d1410a8d7557538c91c204`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:39.408483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa31569fade4508b9ee8bea750f07a3)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:39.409750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bab723da-dfcd-4641-9b71-870dd86829ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:39.410398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:39.417679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 982/1945] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:39 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:39.723721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa31569fade4508b9ee8bea750f07a3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:39.724503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa31569fade4508b9ee8bea750f07a3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:39.725174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa31569fade4508b9ee8bea750f07a3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:39.732050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa31569fade4508b9ee8bea750f07a3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:39.744335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa31569fade4508b9ee8bea750f07a3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:39.899229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 964/1946] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:39 2021] DELETE /identity/v3/users/3aa31569fade4508b9ee8bea750f07a3 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:39.902985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:39.903388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:39.903769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:39.922930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:39.924480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:39.983031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 983/1947] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:39.993151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:39.994541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:40.054380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b417cf-9d1f-4ed4-8b84-488a3285649c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:40.059389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:40.059389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:40.059666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:40.060025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:40.072306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:40.091468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:40.103538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 965/1948] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:40.602121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:40.608287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:40.617504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff1dbf-3250-4a78-9f23-37a4c3e6cdcc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:40.623140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:40.623473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:40.623754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:40.624030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] PATH_INFO: `/v3/projects/7f9cb6d74f3a4cd68ceb26a159406324` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:40.625947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9cb6d74f3a4cd68ceb26a159406324)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:40.627912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:40.777485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:40.779027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:40.791854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72be9f4-7bf5-4337-9ec3-1f702b058340 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:40.796743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:40.797604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:40.797893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:40.798550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] PATH_INFO: `/v3/users/44ed507019b6423c95ed6a6433a56646` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:40.799372 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ed507019b6423c95ed6a6433a56646)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:40.801400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:40.887627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9cb6d74f3a4cd68ceb26a159406324', 'request_id': 'req-a9c1bb09-530e-4f11-9774-98b16004468d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:40.893258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9cb6d74f3a4cd68ceb26a159406324', 'request_id': 'req-a9c1bb09-530e-4f11-9774-98b16004468d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:40.899450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9cb6d74f3a4cd68ceb26a159406324', 'request_id': 'req-a9c1bb09-530e-4f11-9774-98b16004468d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.047743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] The token cache is being invalidate because project 7f9cb6d74f3a4cd68ceb26a159406324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:41.048039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.048704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.050237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 984/1949] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:40 2021] DELETE /identity/v3/projects/7f9cb6d74f3a4cd68ceb26a159406324 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:41.054416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:41.057470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ed507019b6423c95ed6a6433a56646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.058111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ed507019b6423c95ed6a6433a56646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.058714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ed507019b6423c95ed6a6433a56646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.061835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:41.066471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ed507019b6423c95ed6a6433a56646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.080435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-235af46d-5253-43d0-b369-0ed3ad232e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ed507019b6423c95ed6a6433a56646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.133276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bb09-530e-4f11-9774-98b16004468d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:41.137943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:41.138746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:41.139035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:41.139298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] PATH_INFO: `/v3/users/6363701b6c7141b3bc0a8d46779f933f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:41.141022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6363701b6c7141b3bc0a8d46779f933f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:41.142928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:41.183783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 966/1950] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:40 2021] DELETE /identity/v3/users/44ed507019b6423c95ed6a6433a56646 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:41.188448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:41.188730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:41.189024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:41.216535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:41.219630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:41.404094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 967/1951] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:41.409516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6363701b6c7141b3bc0a8d46779f933f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.411256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:41.412932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:41.423671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6363701b6c7141b3bc0a8d46779f933f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.472732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb3e66-9dee-467f-9922-0f5423de2517 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:41.476539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:41.477181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:41.477457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:41.477726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:41.490669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:41.492336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:41.502139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 968/1952] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:41.525891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6363701b6c7141b3bc0a8d46779f933f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.526511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6363701b6c7141b3bc0a8d46779f933f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.527118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6363701b6c7141b3bc0a8d46779f933f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:41.541219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 985/1953] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:41 2021] DELETE /identity/v3/users/6363701b6c7141b3bc0a8d46779f933f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:42.048042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.049655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.069616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1cb7e-488a-497c-8e77-eb81fcda282d service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:42.126308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:42.127195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.127477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.127752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] PATH_INFO: `/v3/projects/179844eb84b845e88a99717f1e6b5aa1` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.128944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=179844eb84b845e88a99717f1e6b5aa1)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:42.130935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:42.150640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.152259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.169413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235623e-050d-4f41-8855-4ae83efc700a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:42.174237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:42.181756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.182050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.182348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] PATH_INFO: `/v3/projects/6537e85b38584474bebf641ac6d1278d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.183553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6537e85b38584474bebf641ac6d1278d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:42.185513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:42.269677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179844eb84b845e88a99717f1e6b5aa1', 'request_id': 'req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.275756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179844eb84b845e88a99717f1e6b5aa1', 'request_id': 'req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.297279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6537e85b38584474bebf641ac6d1278d', 'request_id': 'req-b92092af-5508-4478-9105-8c5630074dd8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.302603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6537e85b38584474bebf641ac6d1278d', 'request_id': 'req-b92092af-5508-4478-9105-8c5630074dd8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.308924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6537e85b38584474bebf641ac6d1278d', 'request_id': 'req-b92092af-5508-4478-9105-8c5630074dd8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.361315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179844eb84b845e88a99717f1e6b5aa1', 'request_id': 'req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.371850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] The token cache is being invalidate because project 179844eb84b845e88a99717f1e6b5aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:42.372139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.372784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.374296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 969/1954] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:42 2021] DELETE /identity/v3/projects/179844eb84b845e88a99717f1e6b5aa1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:42.378187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.379510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.428765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] The token cache is being invalidate because project 6537e85b38584474bebf641ac6d1278d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:42.429077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.429751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b92092af-5508-4478-9105-8c5630074dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.431320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 986/1955] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:42 2021] DELETE /identity/v3/projects/6537e85b38584474bebf641ac6d1278d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:42.437199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6e19-01f2-452b-a959-ed94f6fa025c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.437536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6e19-01f2-452b-a959-ed94f6fa025c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.437824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6e19-01f2-452b-a959-ed94f6fa025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.440054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c669b-7fe6-40b1-8e2c-64d1f4420a4b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:42.457336 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6c3b6e19-01f2-452b-a959-ed94f6fa025c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:42.458560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6c3b6e19-01f2-452b-a959-ed94f6fa025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.495085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:42.495975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.496283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.496563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] PATH_INFO: `/v3/users/8ebb3672574c45eabf8fb000ffcce1ad` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.497918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ebb3672574c45eabf8fb000ffcce1ad)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:42.499868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:42.632297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 987/1956] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:42.641177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.641501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.641816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.659700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:42.660937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.669093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 988/1957] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:42.673227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.682128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b2bad-bcbf-40a4-81db-81374b826c5d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:42.686685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:42.687327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.687609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.689444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.689444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:42.689444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:42.690550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:42.702202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 989/1958] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:40:42.706746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.716707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf43de-9f15-44a9-a6ab-5627bb3c6bfa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:42.721997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:42.722615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:42.722896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:42.723863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:42.723863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:42.725708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:42.813858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ebb3672574c45eabf8fb000ffcce1ad'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.814511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ebb3672574c45eabf8fb000ffcce1ad'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.815118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ebb3672574c45eabf8fb000ffcce1ad'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.822174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ebb3672574c45eabf8fb000ffcce1ad'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.834173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ebb3672574c45eabf8fb000ffcce1ad'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:42.933804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 990/1959] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:42 2021] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:42.938139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:42.939798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:42.966371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 970/1960] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:42 2021] DELETE /identity/v3/users/8ebb3672574c45eabf8fb000ffcce1ad => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:43.003572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5655d5-b3ab-4c3a-8ab9-2982874b3128 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.059078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.059752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.060038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.060354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.061035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.063451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.189302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 991/1961] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:42 2021] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:43.196075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.206356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b6fc9-c1da-40df-a738-ba2d7b03434b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.213023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.213023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.213278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.213697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.214611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.216308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.228656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 971/1962] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:43.232627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.243999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd7b5e-8fd8-4c52-aebd-ec50d36f4657 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.248854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.252246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.252246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.252246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.252246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.253406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.264170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 992/1963] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:43.268309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.278276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b749598-cd5f-4b0f-8e38-97ef4932b802 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.283500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.287928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.287928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.287928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] PATH_INFO: `/v3/projects/d304376bb3ef4354be6761bae02693dd/users/aa6c5aab396d4abfadec6e4b5ea8f8fb/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.299930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d304376bb3ef4354be6761bae02693dd, user_id=aa6c5aab396d4abfadec6e4b5ea8f8fb, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.302739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8765e-9406-4ec9-b93e-7c7aaa1ba25f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.471338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.473488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:43.484359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 972/1964] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:43 2021] PUT /identity/v3/projects/d304376bb3ef4354be6761bae02693dd/users/aa6c5aab396d4abfadec6e4b5ea8f8fb/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:43.494901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.495973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.500811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.501681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04841908-5700-47a7-a9ef-cc91e8c35ff0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.532183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] MFA Rules not processed for user `aa6c5aab396d4abfadec6e4b5ea8f8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:43.533453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:43.585507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.586380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.586794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.587079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] PATH_INFO: `/v3/projects/7c75fcdb60a844fcb8fa2f7d11cb8e49` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.588308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c75fcdb60a844fcb8fa2f7d11cb8e49)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.590341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.608454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 973/1965] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:43 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:43.611909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.622809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ee397-0b7a-47dd-b3c3-c138b6e1f5dd None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.627605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.628367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.628698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.628975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.629656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.631702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:43.861091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 974/1966] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:43 2021] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:43.865035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:43.871859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c75fcdb60a844fcb8fa2f7d11cb8e49', 'request_id': 'req-36ab6afe-5539-4726-bb45-ab8861cbd356'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:43.877532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c75fcdb60a844fcb8fa2f7d11cb8e49', 'request_id': 'req-36ab6afe-5539-4726-bb45-ab8861cbd356'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:43.883837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c75fcdb60a844fcb8fa2f7d11cb8e49', 'request_id': 'req-36ab6afe-5539-4726-bb45-ab8861cbd356'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:43.926144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9190f8b-fe27-466d-a7e8-999b2fe77a41 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:43.930918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:43.931580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:43.931863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:43.932140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:43.932848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:43.934735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.055871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] The token cache is being invalidate because project 7c75fcdb60a844fcb8fa2f7d11cb8e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:44.056153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.056845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.058889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 993/1967] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:43 2021] DELETE /identity/v3/projects/7c75fcdb60a844fcb8fa2f7d11cb8e49 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:44.062307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.064169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:44.093447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 975/1968] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:43 2021] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:44.099172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.106726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:44.121843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4766f-468d-4eca-a736-df7f55c9d0d2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.128091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.129378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.129753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.130168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.131210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.134259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.145524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 976/1969] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:44 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:44.147378 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab6afe-5539-4726-bb45-ab8861cbd356 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.149762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.152242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.153120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.153403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.153680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] PATH_INFO: `/v3/users/8ec9ebfea3514252b9c756f7ebe5cc24` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.154879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec9ebfea3514252b9c756f7ebe5cc24)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.156903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.159863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56a256-68c2-4b18-92f8-3712439dd304 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.164706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.165564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.165846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.166125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] PATH_INFO: `/v3/projects/bb88507343a14ea7bebd18c845f2ec05/users/6feac644619741e0a9819c6c920d34d3/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.183444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb88507343a14ea7bebd18c845f2ec05, user_id=6feac644619741e0a9819c6c920d34d3, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.187112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.400576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 977/1970] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:44 2021] PUT /identity/v3/projects/bb88507343a14ea7bebd18c845f2ec05/users/6feac644619741e0a9819c6c920d34d3/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:44.410257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.460669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec9ebfea3514252b9c756f7ebe5cc24'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.476402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec9ebfea3514252b9c756f7ebe5cc24'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.478186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dcafd-e6e7-4a5d-8164-d0c6bfbae111 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.484952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.485965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.486168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.486461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.487186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.488844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.499158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 978/1971] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:44 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:44.503451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.513913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc3ed-da76-4c57-9122-5cb02638ea91 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.518563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.519435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.519727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.520010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] PATH_INFO: `/v3/projects/bb88507343a14ea7bebd18c845f2ec05/users/6feac644619741e0a9819c6c920d34d3/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.521973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb88507343a14ea7bebd18c845f2ec05, user_id=6feac644619741e0a9819c6c920d34d3, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.524615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4c737-d2cb-4230-9e9e-08ddf1aae1be admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.535504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 979/1972] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:44 2021] PUT /identity/v3/projects/bb88507343a14ea7bebd18c845f2ec05/users/6feac644619741e0a9819c6c920d34d3/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:44.545399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.545693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.546109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.571859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] MFA Rules not processed for user `6feac644619741e0a9819c6c920d34d3`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:44.573102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:44.640090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec9ebfea3514252b9c756f7ebe5cc24'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.640620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec9ebfea3514252b9c756f7ebe5cc24'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.641377 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec9ebfea3514252b9c756f7ebe5cc24'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:44.670435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 994/1973] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:44 2021] DELETE /identity/v3/users/8ec9ebfea3514252b9c756f7ebe5cc24 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:44.681612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 980/1974] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:44 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:44.696393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:44.700978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:44.776587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554001c-a6fa-4af2-bdb8-008dbf3290ae admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:44.780584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:44.781858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:44.782143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:44.782419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:44.850584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:44.852152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:44.865644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 995/1975] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:44 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:45.066632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:45.144188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7524526-ebbb-40c3-983a-3244f8753d75 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:45.148333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:45.148994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:45.149283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:45.149850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:45.151740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:45.216791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:45.218339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:45.229082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 981/1976] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:45 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:45.373332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:45.374818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:45.446085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519692b-7bba-4936-abd6-226f0b2933a2 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:45.450616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:45.451464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:45.451746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:45.452020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] PATH_INFO: `/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:45.453232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b511c6dc7e94c4eb78afd89d79562a0)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:45.455126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:45.643838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:45.645529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:45.660984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c603f-ab7f-4740-a3a0-c260f3b1f6cb service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:45.672762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b511c6dc7e94c4eb78afd89d79562a0', 'request_id': 'req-ea9e6edd-2183-4e56-923c-d47affd1ebad'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:45.685965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b511c6dc7e94c4eb78afd89d79562a0', 'request_id': 'req-ea9e6edd-2183-4e56-923c-d47affd1ebad'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:45.693522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b511c6dc7e94c4eb78afd89d79562a0', 'request_id': 'req-ea9e6edd-2183-4e56-923c-d47affd1ebad'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:45.723736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:45.724881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:45.727680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:45.728008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] PATH_INFO: `/v3/users/aa6c5aab396d4abfadec6e4b5ea8f8fb` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:45.729369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6c5aab396d4abfadec6e4b5ea8f8fb)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:45.731294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:45.917302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] The token cache is being invalidate because project 7b511c6dc7e94c4eb78afd89d79562a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:45.927096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:45.927096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea9e6edd-2183-4e56-923c-d47affd1ebad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:45.927096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 996/1977] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:45 2021] DELETE /identity/v3/projects/7b511c6dc7e94c4eb78afd89d79562a0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:45.928736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f317-87cd-4050-814b-14c44463508a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:45.936962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f317-87cd-4050-814b-14c44463508a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:45.937371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56f317-87cd-4050-814b-14c44463508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:45.959573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4f56f317-87cd-4050-814b-14c44463508a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:45.961029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4f56f317-87cd-4050-814b-14c44463508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:45.973387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 997/1978] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:45.988556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:45.988912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:45.989412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.029081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:46.030310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:46.039231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 998/1979] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:46.043492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.053229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7031d-325b-48e4-bacd-2d17be72535d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.057863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.058619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.058905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.059179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.059889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:46.060191 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.061804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.073213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 999/1980] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:40:46.077335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.086645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aa5db-79fe-4b50-a0b5-f71a6224b425 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.091369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.092000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.092312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.092631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.093299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.095691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.168142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6c5aab396d4abfadec6e4b5ea8f8fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:46.168831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6c5aab396d4abfadec6e4b5ea8f8fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:46.169478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6c5aab396d4abfadec6e4b5ea8f8fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:46.176830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6c5aab396d4abfadec6e4b5ea8f8fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:46.189218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc67f585-89b1-471d-b136-122c3a304551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6c5aab396d4abfadec6e4b5ea8f8fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:46.300301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1000/1981] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:46 2021] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:46.304594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.306947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:46.376584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 982/1982] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:45 2021] DELETE /identity/v3/users/aa6c5aab396d4abfadec6e4b5ea8f8fb => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:46.378897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.379498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.379715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a76f-a605-4fe9-bd68-97700b9c4c30 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.380168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.416478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:46.420233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:46.451953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.453717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.454011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.454311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.455003 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.457434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.505340 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 983/1983] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:46.515463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.517063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:46.574366 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777be40-1552-4688-9a1d-dacb3e9061a2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.578356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.579011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.579298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.579575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.589351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.590788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.602217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 984/1984] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:46.644528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1001/1985] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:46 2021] POST /identity/v3/users => generated 286 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:46.646892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.672457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66e89-7e5d-4199-be1f-76eff16ad074 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.674000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.675157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.675859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.676742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.678416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.681779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.707374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 985/1986] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:46 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:46.712705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.726864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286667-30d3-4eae-94c7-5ed231efe88f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.733484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.735121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.736765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.737170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.738924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.742628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70209210-9279-4f09-b053-c33d1329af0c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:46.762795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1002/1987] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:46 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:46.765286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:46.784116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7548a7-fd76-4769-98f1-8cdc073dec22 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:46.793119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:46.795071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:46.795725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:46.796402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] PATH_INFO: `/v3/projects/5f0204f777304ab3b74f1337b5cd27f4/users/e03f5ae54dd9400f8cf370b5bf209181/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:46.823466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0204f777304ab3b74f1337b5cd27f4, user_id=e03f5ae54dd9400f8cf370b5bf209181, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:46.828244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:47.020672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 986/1988] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:46 2021] PUT /identity/v3/projects/5f0204f777304ab3b74f1337b5cd27f4/users/e03f5ae54dd9400f8cf370b5bf209181/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:47.031908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.032215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.032499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.061435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] MFA Rules not processed for user `e03f5ae54dd9400f8cf370b5bf209181`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:47.062964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:47.141261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1003/1989] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:47 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:47.153591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:47.155402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:47.217214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69d07-5042-4013-a13f-d2adcd465df9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:47.221149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:47.221864 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.222253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.222552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.231206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:47.232678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:47.242263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 987/1990] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:47 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:47.279797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:47.343786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d10b4-334e-4296-9904-98fefe4efa58 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:47.348506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:47.365739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.365739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.365739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] PATH_INFO: `/v3/users/e03f5ae54dd9400f8cf370b5bf209181` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.365739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03f5ae54dd9400f8cf370b5bf209181)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:47.365739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:47.407995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:47.409508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:47.423823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b0a6-108e-4384-9ab0-232dae170caa service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:47.428700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:47.429631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.429986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.430202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] PATH_INFO: `/v3/projects/d304376bb3ef4354be6761bae02693dd` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.431466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d304376bb3ef4354be6761bae02693dd)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:47.433451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:47.577063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03f5ae54dd9400f8cf370b5bf209181'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.582365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd304376bb3ef4354be6761bae02693dd', 'request_id': 'req-f38ae0bd-f599-4791-ac2d-340067335d5b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.589297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd304376bb3ef4354be6761bae02693dd', 'request_id': 'req-f38ae0bd-f599-4791-ac2d-340067335d5b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.594166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03f5ae54dd9400f8cf370b5bf209181'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.777504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd304376bb3ef4354be6761bae02693dd', 'request_id': 'req-f38ae0bd-f599-4791-ac2d-340067335d5b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.789814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] The token cache is being invalidate because project d304376bb3ef4354be6761bae02693dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:47.790111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.790905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.792799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 988/1991] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:47 2021] DELETE /identity/v3/projects/d304376bb3ef4354be6761bae02693dd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:47.797557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:47.798922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:47.867740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae0bd-f599-4791-ac2d-340067335d5b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:47.872522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:47.873585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.873871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.874919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] PATH_INFO: `/v3/users/6feac644619741e0a9819c6c920d34d3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.876129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6feac644619741e0a9819c6c920d34d3)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:47.878106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:47.892561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03f5ae54dd9400f8cf370b5bf209181'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.893496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03f5ae54dd9400f8cf370b5bf209181'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.894204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-c39ce4c9-17a3-416b-81a4-bd0a8ce45a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03f5ae54dd9400f8cf370b5bf209181'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:47.908345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1004/1992] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:47 2021] DELETE /identity/v3/users/e03f5ae54dd9400f8cf370b5bf209181 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:47.914618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:47.914943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:47.915462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:47.935537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:47.936964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:48.000539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1005/1993] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:48.010361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:48.011762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:48.073705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1aca5e-ac3c-4114-8f36-f7a8523bb358 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:48.078530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:48.079290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:48.082225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:48.082225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:48.094527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:48.096134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:48.113798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1006/1994] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:48.139567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6feac644619741e0a9819c6c920d34d3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.139567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6feac644619741e0a9819c6c920d34d3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.139567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6feac644619741e0a9819c6c920d34d3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.144896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6feac644619741e0a9819c6c920d34d3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.161660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6feac644619741e0a9819c6c920d34d3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.322935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 989/1995] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:47 2021] DELETE /identity/v3/users/6feac644619741e0a9819c6c920d34d3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:48.597505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:48.599686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:48.613572 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab1e1-8cfc-484f-968d-3001107e86a4 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:48.660600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:48.662163 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:48.687786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:48.688791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:48.689589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:48.689882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] PATH_INFO: `/v3/users/9e6d9822cef54884a77735f74c787260` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:48.692383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6d9822cef54884a77735f74c787260)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:48.695804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:48.750618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40528f-3ae0-4fc7-97b2-0f147da57cd2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:48.755737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:48.757081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:48.757377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:48.758062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] PATH_INFO: `/v3/projects/5f0204f777304ab3b74f1337b5cd27f4` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:48.760176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0204f777304ab3b74f1337b5cd27f4)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:48.762637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:48.975513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6d9822cef54884a77735f74c787260'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.976042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0204f777304ab3b74f1337b5cd27f4', 'request_id': 'req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.983121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0204f777304ab3b74f1337b5cd27f4', 'request_id': 'req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:48.990431 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6d9822cef54884a77735f74c787260'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.060104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0204f777304ab3b74f1337b5cd27f4', 'request_id': 'req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.083847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] The token cache is being invalidate because project 5f0204f777304ab3b74f1337b5cd27f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:49.084388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.085861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-7d7b49cc-262b-4b8b-8642-05f3c9128c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.087901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 990/1996] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:48 2021] DELETE /identity/v3/projects/5f0204f777304ab3b74f1337b5cd27f4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:49.094875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a43-1c4b-4aa3-a2d0-692d87df2fb8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.095886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a43-1c4b-4aa3-a2d0-692d87df2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.096392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed0a43-1c4b-4aa3-a2d0-692d87df2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.124042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1eed0a43-1c4b-4aa3-a2d0-692d87df2fb8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:49.125370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1eed0a43-1c4b-4aa3-a2d0-692d87df2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.183734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6d9822cef54884a77735f74c787260'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.193236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6d9822cef54884a77735f74c787260'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.193236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-651586e9-0884-46e7-baba-8d0f8dfec218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6d9822cef54884a77735f74c787260'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.199254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 991/1997] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:49.202030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1007/1998] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:48 2021] DELETE /identity/v3/users/9e6d9822cef54884a77735f74c787260 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:49.206621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.207129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.207563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.207901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.208301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.209024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.226574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:49.227321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:49.227703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.228528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.290053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1008/1999] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:49.294276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 992/2000] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:49.303298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.306369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.308025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.313909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55cbfb-eae4-478d-9ad2-efa4e011c34f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.319578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.320302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.320591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.320874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.321708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:49.322231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.329470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.347001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1009/2001] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:49.347001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.348860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.364253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f525a50-efac-4e6d-b9cf-e2325e691197 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.369356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.370361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.370702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.371133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] PATH_INFO: `/v3/projects/bb88507343a14ea7bebd18c845f2ec05` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.372650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb88507343a14ea7bebd18c845f2ec05)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.374461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.436297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da51bdf-1bcc-4dd2-a697-b79450977d0c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.440739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.441406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.441694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.441977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.451784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.453309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.463512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 993/2002] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:49.464436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.475052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93367792-3a41-4801-8c16-2e20d048e986 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.481077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.481891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.482247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.482598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.483613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.486653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.521376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb88507343a14ea7bebd18c845f2ec05', 'request_id': 'req-ffcdb5ad-92a1-4473-9df0-860b753346c9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.528145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb88507343a14ea7bebd18c845f2ec05', 'request_id': 'req-ffcdb5ad-92a1-4473-9df0-860b753346c9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.536061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb88507343a14ea7bebd18c845f2ec05', 'request_id': 'req-ffcdb5ad-92a1-4473-9df0-860b753346c9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.647995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 994/2003] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:49.654955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.676365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] The token cache is being invalidate because project bb88507343a14ea7bebd18c845f2ec05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:49.676961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.678190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ffcdb5ad-92a1-4473-9df0-860b753346c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:49.681638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1010/2004] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:49 2021] DELETE /identity/v3/projects/bb88507343a14ea7bebd18c845f2ec05 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:49.691361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5c75-14e8-4499-a410-8d7aa0ecd498 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.691850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5c75-14e8-4499-a410-8d7aa0ecd498 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.692131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce5c75-14e8-4499-a410-8d7aa0ecd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.710285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-08ce5c75-14e8-4499-a410-8d7aa0ecd498 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:49.711806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-08ce5c75-14e8-4499-a410-8d7aa0ecd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.778243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98249a0f-c300-4ee2-84c9-4b6cea9ceb7f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.778243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.778243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.778243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.779553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.779553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.779553 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.798350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1011/2005] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:49.807508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.807807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.811581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.832618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:49.833896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.842111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1012/2006] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:49.851849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.861984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9baa43e-11e3-46c3-8111-56ab48b1d26e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.867395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.868246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.868541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.868810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.869553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:49.869861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.871467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.884133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1013/2007] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:40:49.888454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.898983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9f0ac-6b80-4cbc-90ab-8e2cc3cdfd29 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.904181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.904870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.905174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.905515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.906379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:49.908417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:49.973103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 995/2008] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/users => generated 287 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:49.978754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:49.978754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:49.990973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41054ad-5ebb-4c7d-aaf0-79a6ba096942 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:49.996272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:49.996967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:49.997279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:49.997609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:49.998312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.000505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.012034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 996/2009] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:50.021399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.031178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadad19-d414-4875-a970-17dd4ad834c1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.035887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.036637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.037108 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.037400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.038183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.039845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.048248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1014/2010] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:49 2021] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:50.052554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 997/2011] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:50.056844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.057367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.069073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251e8c-320c-444c-b833-b65604400782 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.161597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8a6a6-1083-493d-ad0c-c33a65d4bf5b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.166911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.167828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.168116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.168435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] PATH_INFO: `/v3/projects/6f912b62093449cea652d5e2b536ac2a/users/de20e4d4713d492cbf99cc584bf0446b/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.169600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.170470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.171174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.172129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.173980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.176110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.187693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f912b62093449cea652d5e2b536ac2a, user_id=de20e4d4713d492cbf99cc584bf0446b, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.190600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.344840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 998/2012] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:50.346462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.349895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.363700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0828-6e2a-49dc-8610-d28c14976823 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.368470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.369367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.369633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.369904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] PATH_INFO: `/v3/projects/eb3d1d340d154f7c9929184b98414377` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.371074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3d1d340d154f7c9929184b98414377)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.372967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.378090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1015/2013] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:50 2021] PUT /identity/v3/projects/6f912b62093449cea652d5e2b536ac2a/users/de20e4d4713d492cbf99cc584bf0446b/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:40:50.378998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.441222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9d29a-d70d-4edf-b9ec-47cc5fe9761e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.445924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.446607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.446957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.447239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.447963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.449599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b76d2-1a41-4cd5-9df7-8d06e9ae1445 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.459877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1016/2014] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:50.461121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.461480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.461725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.482102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3d1d340d154f7c9929184b98414377', 'request_id': 'req-529eea8d-4d74-439f-8d70-96a79b51ea4a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:50.488717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3d1d340d154f7c9929184b98414377', 'request_id': 'req-529eea8d-4d74-439f-8d70-96a79b51ea4a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:50.489186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] MFA Rules not processed for user `de20e4d4713d492cbf99cc584bf0446b`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:50.490402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.551304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1017/2015] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:50.553234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.614837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10492e77-d5c5-4e3b-b961-270fccb9bc52 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.617229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3d1d340d154f7c9929184b98414377', 'request_id': 'req-529eea8d-4d74-439f-8d70-96a79b51ea4a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:50.619549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.622200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.622200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.622200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.622200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.625598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b689e-ae5f-45ca-950f-cd2ed77a4e86 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.629796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] The token cache is being invalidate because project eb3d1d340d154f7c9929184b98414377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:50.630090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:50.630790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:50.632380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 999/2016] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:50 2021] DELETE /identity/v3/projects/eb3d1d340d154f7c9929184b98414377 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:50.633269 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.637183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1018/2017] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:50.637325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.638005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.638413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.638696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.657128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:50.658343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.666348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1019/2018] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:50.671447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.671447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.679462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8b7c9-6b46-4e45-b0b5-40b6ab95fa08 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.684109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.685018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.685299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.685578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] PATH_INFO: `/v3/projects/c094b5a972e741a29fd9aff1ecc631af/users/6f1cb54d7de84adb9ac491a0ad6f009d/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.690828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eea8d-4d74-439f-8d70-96a79b51ea4a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.694520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.695261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.695540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.695815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.697599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.700958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c094b5a972e741a29fd9aff1ecc631af, user_id=6f1cb54d7de84adb9ac491a0ad6f009d, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.704370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a921d-81e7-4328-90f1-85db9275832f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.709192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.710613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1c0aa1-d439-480a-be8c-1a8ccc3e07e0 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.719609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1000/2019] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:50.720891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.721186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.721526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.738665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:50.739845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.747775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1001/2020] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:50.752268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.762812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad248-3f43-4162-b0b6-9a9672cdb6a5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.768625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.769296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.769600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.769998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.770749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:50.771056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.772736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.785377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1002/2021] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:40:50.800439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.810157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810c71-cc85-4f10-a198-fbc7e5588cc3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:50.815356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:50.815998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.816319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.816628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.817307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:50.819175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:50.835380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1020/2022] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:50 2021] PUT /identity/v3/projects/c094b5a972e741a29fd9aff1ecc631af/users/6f1cb54d7de84adb9ac491a0ad6f009d/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:50.845694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:50.846009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:50.846283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:50.876125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] MFA Rules not processed for user `6f1cb54d7de84adb9ac491a0ad6f009d`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:50.876125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:50.939971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1003/2023] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:50.944962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.963084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1021/2024] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:50.975129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:50.977312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:51.018024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8a6f-843a-415a-8d6b-42c6b3a86263 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.032852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.034065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.034457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.035375 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.036353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.039245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.049164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc092369-f778-4f88-b3c8-4ab825b0a19b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.119878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.121682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.122182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.122735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.185422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1004/2025] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:50 2021] POST /identity/v3/users => generated 284 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:51.189236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:51.198073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.199645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.206717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7b678-06f3-44b2-92ab-47c68b70581e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.211633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.213042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.213365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.213743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.214480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.216775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.223179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1022/2026] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:50 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:51.231378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1005/2027] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:51.247625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:51.264025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaedd2-52c1-4dd9-a037-1b1fee47a7f9 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.270502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.271388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.271842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.272122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.273038 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.274869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f3510-3cbb-402c-bda8-8249ec97ea58 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.289838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1023/2028] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:51 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:51.291067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:51.301750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179595d-2619-48c9-b6ea-d7a104a27e25 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.309839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.311412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.311709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.312025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] PATH_INFO: `/v3/projects/2f0caf7ca180469f967a3d5c38c02bb7/users/1bd544cc9a99494f82f424da956e84e7/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.330571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0caf7ca180469f967a3d5c38c02bb7, user_id=1bd544cc9a99494f82f424da956e84e7, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.333201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.480400 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1006/2029] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:51 2021] PUT /identity/v3/projects/2f0caf7ca180469f967a3d5c38c02bb7/users/1bd544cc9a99494f82f424da956e84e7/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:51.491794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db042-a4e3-468c-9ce8-8864f554d211 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.496595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db042-a4e3-468c-9ce8-8864f554d211 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.496595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db042-a4e3-468c-9ce8-8864f554d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.520745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d61db042-a4e3-468c-9ce8-8864f554d211 None None] MFA Rules not processed for user `1bd544cc9a99494f82f424da956e84e7`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:51.521930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d61db042-a4e3-468c-9ce8-8864f554d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:51.586944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1024/2030] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:51 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:51.598924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:51.600669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:51.658650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47cf4-7f37-4cb2-8a10-80dbf49e53f2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:51.662293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:51.663015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:51.663295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:51.663572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:51.672125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:51.673656 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:51.682273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1007/2031] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:51 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:40:53.742199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f9ad-027e-4920-9689-e2ef1481fc31 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:53.742670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f9ad-027e-4920-9689-e2ef1481fc31 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:53.742785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f9ad-027e-4920-9689-e2ef1481fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:53.761392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-25d5f9ad-027e-4920-9689-e2ef1481fc31 None None] MFA Rules not processed for user `de20e4d4713d492cbf99cc584bf0446b`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:53.762594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-25d5f9ad-027e-4920-9689-e2ef1481fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:53.821662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1025/2032] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:53 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:56.795032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:56.868775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd1c3-bd9f-41e7-80d9-b723cc214162 service glance] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:56.872568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:56.873652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:56.873991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:56.878455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] PATH_INFO: `/v3/users/6f1cb54d7de84adb9ac491a0ad6f009d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:56.878455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1cb54d7de84adb9ac491a0ad6f009d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:56.878455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:57.192536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1cb54d7de84adb9ac491a0ad6f009d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:57.193303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1cb54d7de84adb9ac491a0ad6f009d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:57.194016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1cb54d7de84adb9ac491a0ad6f009d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:57.203811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1cb54d7de84adb9ac491a0ad6f009d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:57.216970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1cb54d7de84adb9ac491a0ad6f009d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:57.389110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1008/2033] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:40:56 2021] DELETE /identity/v3/users/6f1cb54d7de84adb9ac491a0ad6f009d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:57.393837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:57.398146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:57.398525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:57.418290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:57.418290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:57.475544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1026/2034] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:57.486367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:57.488060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:57.571867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee95f12-7f17-4b06-9fe5-4f35472b3e06 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:57.575454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:57.576099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:57.576416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:57.578543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:57.585619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:57.587056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab370b-9afb-46d9-b8fc-ccf5852b0df3 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:57.597387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1009/2035] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:40:58.035814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.037674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:58.049984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41188bb-8ff1-449d-9b8e-5406b2696ffb None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.054627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.055515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.055829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.056108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] PATH_INFO: `/v3/projects/c094b5a972e741a29fd9aff1ecc631af` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.057331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c094b5a972e741a29fd9aff1ecc631af)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.059235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.166239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c094b5a972e741a29fd9aff1ecc631af', 'request_id': 'req-76821ff9-6ecf-41ef-8a84-ea05a59d563f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:58.171909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c094b5a972e741a29fd9aff1ecc631af', 'request_id': 'req-76821ff9-6ecf-41ef-8a84-ea05a59d563f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:58.178619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c094b5a972e741a29fd9aff1ecc631af', 'request_id': 'req-76821ff9-6ecf-41ef-8a84-ea05a59d563f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:58.263469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] The token cache is being invalidate because project c094b5a972e741a29fd9aff1ecc631af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:40:58.264149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:58.265092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-76821ff9-6ecf-41ef-8a84-ea05a59d563f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:40:58.269353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1027/2036] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:40:58 2021] DELETE /identity/v3/projects/c094b5a972e741a29fd9aff1ecc631af => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:58.278772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.279351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.279351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.297086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:58.298550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:58.363098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1010/2037] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:40:58.371975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.372654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.373396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.401878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:58.403067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:58.411149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1028/2038] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:58.415384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.425595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c714-2e83-4c29-9a8b-2b97086d07c3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.430260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.430912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.431208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.436343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.436343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:40:58.436343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.436343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.445929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1011/2039] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:40:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:40:58.450322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.459502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96abaf-5040-4dd6-ac2e-1460eeb39352 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.464132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.464810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.465093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.466552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.466552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.467961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.579435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1029/2040] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:40:58 2021] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:40:58.587181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.593562 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed1ea-2f68-43e5-96a8-f1f1394839ff admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.661876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.662548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.662832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.663106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.663800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.665717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.829958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1012/2041] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:40:58 2021] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:40:58.834318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.845831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33803b-d473-4510-9cf1-f33325bfa2a9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.850703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.851453 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.851840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.852226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.853026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.854713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.868917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1030/2042] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:40:58.873137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.883015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa51089-611c-47d8-8970-b9cc5a88d683 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.887737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.888434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.888721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.889000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.889751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.891364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bdb7f-2476-42c8-bfdc-f51972111cfd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:58.901601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1013/2043] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:40:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:40:58.906364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:58.917429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c026ae-8056-4d57-a69f-40e86aa9255e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:58.923106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:58.924119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:58.924857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:58.925292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] PATH_INFO: `/v3/projects/db23d448427540ee9db29ee99f9fdccb/users/f1d393938d884ce4aa169e30fb128111/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:58.941518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db23d448427540ee9db29ee99f9fdccb, user_id=f1d393938d884ce4aa169e30fb128111, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:58.944347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:59.087282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1031/2044] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:40:58 2021] PUT /identity/v3/projects/db23d448427540ee9db29ee99f9fdccb/users/f1d393938d884ce4aa169e30fb128111/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:40:59.106344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f168-5cab-4029-96f6-c743887c9337 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:59.106641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f168-5cab-4029-96f6-c743887c9337 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:59.106925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655f168-5cab-4029-96f6-c743887c9337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:59.133722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d655f168-5cab-4029-96f6-c743887c9337 None None] MFA Rules not processed for user `f1d393938d884ce4aa169e30fb128111`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:40:59.134909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d655f168-5cab-4029-96f6-c743887c9337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:59.199631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1014/2045] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:40:59 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:40:59.210235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:40:59.212019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:40:59.319112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c437-1da7-4ccb-8a79-26ef0d412c4c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:40:59.323086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:40:59.323848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:40:59.324228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:40:59.324688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:40:59.334795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:40:59.336374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:40:59.346635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1032/2046] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:40:59 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:12.389608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248887f-3d0d-4dc6-9211-2e54d2beaeaa None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:12.390773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248887f-3d0d-4dc6-9211-2e54d2beaeaa None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:12.390858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248887f-3d0d-4dc6-9211-2e54d2beaeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:12.418020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e248887f-3d0d-4dc6-9211-2e54d2beaeaa None None] MFA Rules not processed for user `84491dcbe2d1410a8d7557538c91c204`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:12.419460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e248887f-3d0d-4dc6-9211-2e54d2beaeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:12.500390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1015/2047] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:12.659649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:12.767380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1fc31-0358-4e82-9011-1803ac2eaacd service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:12.772086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:12.772981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:12.773263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:12.773536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] PATH_INFO: `/v3/users/f1d393938d884ce4aa169e30fb128111` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:12.774739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d393938d884ce4aa169e30fb128111)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:12.776694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:13.130173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d393938d884ce4aa169e30fb128111'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:13.143599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d393938d884ce4aa169e30fb128111'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:13.268234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d393938d884ce4aa169e30fb128111'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:13.269035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d393938d884ce4aa169e30fb128111'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:13.269809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d393938d884ce4aa169e30fb128111'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:13.291750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1033/2048] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:41:12 2021] DELETE /identity/v3/users/f1d393938d884ce4aa169e30fb128111 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:13.293913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:13.295121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:13.295717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:13.347140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:13.348521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:13.428475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1016/2049] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:13.440275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:13.441100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:13.539379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6f176-ab35-4c56-948e-856de3550885 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:13.543425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:13.544143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:13.544517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:13.544861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:13.554545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:13.556032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fdb72-b348-440c-a3ae-c0559e9e06a5 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:13.566523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1034/2050] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:14.121955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:14.123461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:14.136487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ec4e9-0fe0-444e-a204-dc331336c792 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:14.141306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:14.142288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.143131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.143565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] PATH_INFO: `/v3/projects/db23d448427540ee9db29ee99f9fdccb` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.144841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db23d448427540ee9db29ee99f9fdccb)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:14.146773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:14.305774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db23d448427540ee9db29ee99f9fdccb', 'request_id': 'req-54c184cd-4b63-42b0-bb4a-dda5b481415c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:14.312967 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db23d448427540ee9db29ee99f9fdccb', 'request_id': 'req-54c184cd-4b63-42b0-bb4a-dda5b481415c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:14.446600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db23d448427540ee9db29ee99f9fdccb', 'request_id': 'req-54c184cd-4b63-42b0-bb4a-dda5b481415c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:14.460496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] The token cache is being invalidate because project db23d448427540ee9db29ee99f9fdccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:41:14.460799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:14.461507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-54c184cd-4b63-42b0-bb4a-dda5b481415c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:14.463650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1017/2051] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:41:14 2021] DELETE /identity/v3/projects/db23d448427540ee9db29ee99f9fdccb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:14.469658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.470183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.470528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.510475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:14.511690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:14.579078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1035/2052] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:14.582155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.582270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.582694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.602407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:14.603630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:14.611801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1018/2053] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:14.615971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:14.628436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508006b-eb07-4101-81c7-9198935239e9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:14.633634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:14.634308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.634596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.634873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.635599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:41:14.635908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:14.637530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:14.650019 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1036/2054] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:41:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:41:14.662882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:14.665872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b2ee-f342-4acc-a1ea-dac433feaa5e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:14.670716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:14.671376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.671660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.671936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.672683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:14.674565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:14.824690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1019/2055] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:41:14 2021] POST /identity/v3/projects => generated 397 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:14.829395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:14.840964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2634c3-10f2-4c82-b28c-b5f0d47a35a1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:14.897439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:14.898127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:14.898413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:14.898693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:14.899375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:14.901346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:15.046720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1037/2056] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:41:14 2021] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:15.051043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:15.061727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230527-fb9a-4f8a-8582-7dcceda05ec0 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:15.066910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:15.067571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:15.067931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:15.068243 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:15.068970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:15.070565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:15.081926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1020/2057] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:15 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:15.088149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:15.099957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2bcd-a081-4d29-9cfe-15cc83753598 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:15.105034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:15.108101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:15.108101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:15.108101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:15.108101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:15.114145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac947-35ab-4132-9fe5-5ce61aee96af admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:15.123561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1038/2058] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:15 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:15.124952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:15.135762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbd1b0-81cb-4388-a75f-d81b3e51497b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:15.141779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:15.143149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:15.143571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:15.143920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] PATH_INFO: `/v3/projects/929877d0ec594bb0a885c96e7efd2a53/users/576572ad846844379a96d9ccacf02c23/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:15.160711 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929877d0ec594bb0a885c96e7efd2a53, user_id=576572ad846844379a96d9ccacf02c23, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:15.163552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:15.304104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1021/2059] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:41:15 2021] PUT /identity/v3/projects/929877d0ec594bb0a885c96e7efd2a53/users/576572ad846844379a96d9ccacf02c23/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:15.315241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2bc2-91b7-4b3e-8def-1e07c2dffc6a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:15.315621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2bc2-91b7-4b3e-8def-1e07c2dffc6a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:15.315937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de2bc2-91b7-4b3e-8def-1e07c2dffc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:15.344283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-82de2bc2-91b7-4b3e-8def-1e07c2dffc6a None None] MFA Rules not processed for user `576572ad846844379a96d9ccacf02c23`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:15.345579 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-82de2bc2-91b7-4b3e-8def-1e07c2dffc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:15.411904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1039/2060] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:15 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:15.423022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:15.424752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:15.483563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf8-4e22-41fc-a919-b063a9959168 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:15.488185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:15.489068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:15.489512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:15.489791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:15.499111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:15.501330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0e01d-b27d-467f-9a56-2da9fa4e558c service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:15.511211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1022/2061] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:15 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:18.104501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:18.104972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:18.105065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:18.126284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] MFA Rules not processed for user `cb4a0eaef1ba4df5a07bda5bef95dd99`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:18.127690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:18.209241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1040/2062] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:18 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:20.516172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85644-a64a-4a94-bb9f-ac071be61f89 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:20.517259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85644-a64a-4a94-bb9f-ac071be61f89 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:20.517696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e85644-a64a-4a94-bb9f-ac071be61f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:20.540875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-26e85644-a64a-4a94-bb9f-ac071be61f89 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:20.542275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-26e85644-a64a-4a94-bb9f-ac071be61f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:20.611290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1023/2063] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:41:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:20.661673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:20.663935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:20.747901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477c27-0e8e-409b-8576-f04c132b7c5a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:20.753632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:20.754279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:20.754570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:20.754852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:20.763978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:20.766266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:20.774394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1041/2064] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:41:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:22.404900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea5f-37b9-4eda-84ca-e68c9510b664 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:22.405292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea5f-37b9-4eda-84ca-e68c9510b664 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:22.406545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09ea5f-37b9-4eda-84ca-e68c9510b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:22.423435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0b09ea5f-37b9-4eda-84ca-e68c9510b664 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:22.424641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0b09ea5f-37b9-4eda-84ca-e68c9510b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:22.431762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1024/2065] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:41:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:22.445257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:22.455423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178590c-0175-4957-9fe6-97c687fcaaf6 service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:22.460473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:22.461097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:22.461403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:22.461672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:22.471308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:22.472948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:22.481198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1042/2066] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:41:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:23.346657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:23.346948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:23.347230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:23.365395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:23.366581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:23.373637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1025/2067] 10.222.0.21 () {58 vars in 968 bytes} [Tue Aug 10 03:41:23 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:23.387153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:23.398164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de13a-9b9d-4873-a274-f2013c3684cd service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:23.404628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:23.405291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:23.405580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:23.405860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:23.414854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:23.416492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6aaea2-74bd-4687-828f-d1f4a0d293ba service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:23.435055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1043/2068] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:41:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:32.433067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:32.434515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:32.498005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80243b38-be23-4627-b090-7f4d755c6bb7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:32.502551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:32.503403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:32.503685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:32.503962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] PATH_INFO: `/v3/users/de20e4d4713d492cbf99cc584bf0446b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:32.505165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de20e4d4713d492cbf99cc584bf0446b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:32.507045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:32.774728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de20e4d4713d492cbf99cc584bf0446b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:32.775499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de20e4d4713d492cbf99cc584bf0446b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:32.776224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de20e4d4713d492cbf99cc584bf0446b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:32.783636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de20e4d4713d492cbf99cc584bf0446b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:32.797319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de20e4d4713d492cbf99cc584bf0446b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:32.881064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1026/2069] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:41:32 2021] DELETE /identity/v3/users/de20e4d4713d492cbf99cc584bf0446b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:32.885661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:32.888032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:32.888032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:32.911714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:32.913366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:32.996951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1044/2070] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:33.010496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:33.010496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:33.080410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798a58a-ba52-4376-8867-87e66c842e7a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:33.082166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:33.083412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:33.083852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:33.084320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:33.096580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:33.098541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:33.111418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1027/2071] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:41:33.266119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:33.267820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:33.285249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d1640-bdd9-410d-a654-ee2913778e62 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:33.287421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:33.288678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:33.289134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:33.289613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] PATH_INFO: `/v3/users/576572ad846844379a96d9ccacf02c23` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:33.292225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=576572ad846844379a96d9ccacf02c23)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:33.294529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:33.458294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:33.459772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:33.473545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c418e-7af9-4fff-94ef-759360fdcacf service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:33.482336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:33.482884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:33.483318 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:33.488454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] PATH_INFO: `/v3/projects/6f912b62093449cea652d5e2b536ac2a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:33.495443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f912b62093449cea652d5e2b536ac2a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:33.497911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:33.502590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576572ad846844379a96d9ccacf02c23'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.516189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576572ad846844379a96d9ccacf02c23'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.679732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576572ad846844379a96d9ccacf02c23'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.680508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576572ad846844379a96d9ccacf02c23'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.681344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-30b0d54f-8e57-4fec-b4bf-60bb20f003ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576572ad846844379a96d9ccacf02c23'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.698141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1045/2072] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:41:33 2021] DELETE /identity/v3/users/576572ad846844379a96d9ccacf02c23 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:33.702635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:33.702927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:33.703231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:33.710376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f912b62093449cea652d5e2b536ac2a', 'request_id': 'req-78f4afee-0081-4dc5-ac12-708e4b111e16'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.716703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f912b62093449cea652d5e2b536ac2a', 'request_id': 'req-78f4afee-0081-4dc5-ac12-708e4b111e16'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:33.723207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:33.724554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:33.850625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1046/2073] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:33.863334 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:33.866894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:33.927751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6172f-2769-442e-94dd-639832a025dd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:33.931477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:33.932126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:33.932444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:33.932724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:33.942208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:33.943642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:33.952965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1047/2074] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:34.016720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f912b62093449cea652d5e2b536ac2a', 'request_id': 'req-78f4afee-0081-4dc5-ac12-708e4b111e16'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.027864 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] The token cache is being invalidate because project 6f912b62093449cea652d5e2b536ac2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:41:34.028187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.028877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-78f4afee-0081-4dc5-ac12-708e4b111e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.030951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1028/2075] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:41:33 2021] DELETE /identity/v3/projects/6f912b62093449cea652d5e2b536ac2a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:41:34.555476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:34.557260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:34.570587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310e932-7939-4a34-84d3-4c39bc0f66d2 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:34.575174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:34.576033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:34.576355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:34.580352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] PATH_INFO: `/v3/projects/929877d0ec594bb0a885c96e7efd2a53` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:34.580352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929877d0ec594bb0a885c96e7efd2a53)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:34.580352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:34.818050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929877d0ec594bb0a885c96e7efd2a53', 'request_id': 'req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.823366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929877d0ec594bb0a885c96e7efd2a53', 'request_id': 'req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.830138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929877d0ec594bb0a885c96e7efd2a53', 'request_id': 'req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.918824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] The token cache is being invalidate because project 929877d0ec594bb0a885c96e7efd2a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:41:34.919346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.919973 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b50b9ef1-68c0-4d01-ab72-6fd5ef8e7255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:34.921564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1048/2076] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:41:34 2021] DELETE /identity/v3/projects/929877d0ec594bb0a885c96e7efd2a53 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:34.929041 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:34.929627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:34.929627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:34.958399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:34.959591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:35.021107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1029/2077] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:41:35.029396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.029890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.029980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.049135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:35.050200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:35.058329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1049/2078] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:35.063065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.078699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9bc9-ca82-4af2-90f3-e569ff9dc381 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.078699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.079006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.079132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.079356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.080116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:41:35.080463 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.082047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.094290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1030/2079] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:41:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:41:35.098933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.110682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3bdf7-2282-4498-9420-11f17fda59b8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.115655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.116349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.116637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.116916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.117630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.119555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.275988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1050/2080] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:41:35 2021] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:35.281036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.291131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4d26-68f5-4d14-a5b9-0ff5130cf32d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.346359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.346990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.347272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.347547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.348275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.350175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.490415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1031/2081] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:41:35 2021] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:35.492108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.511249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699821ed-25eb-4ecd-8089-48a3f1113583 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.524256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.525186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.525544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.525893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.526703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.530111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.552844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1051/2082] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:35 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:35.558613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.573530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f144-12dd-4f0e-ab8b-9689e7d445cd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.579982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.580989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.581280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.581558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.582450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.584078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284d24-add6-4609-bb62-6b4fed299488 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.600271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1032/2083] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:35 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:41:35.601855 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.612383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32477d5-62d7-4698-9a28-0ac7eb00e9ea admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:35.617684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:35.618774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.619304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.619647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] PATH_INFO: `/v3/projects/77aab94ffcab4a8b9ad529c5a5454ae9/users/f35d508678b14f2583abf9ba5ae7fb91/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.651359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=77aab94ffcab4a8b9ad529c5a5454ae9, user_id=f35d508678b14f2583abf9ba5ae7fb91, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:35.654539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:35.785157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1052/2084] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:41:35 2021] PUT /identity/v3/projects/77aab94ffcab4a8b9ad529c5a5454ae9/users/f35d508678b14f2583abf9ba5ae7fb91/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:35.789436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbb3d-b23c-4c2a-bf4a-7406f4a53d87 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:35.789735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbb3d-b23c-4c2a-bf4a-7406f4a53d87 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:35.790954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bbb3d-b23c-4c2a-bf4a-7406f4a53d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:35.818090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-381bbb3d-b23c-4c2a-bf4a-7406f4a53d87 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:35.819377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-381bbb3d-b23c-4c2a-bf4a-7406f4a53d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:35.907913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1033/2085] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:35.917710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:35.919556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:35.982295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c68639-2838-4511-86db-fb2a178224ff admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:36.004165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:36.004165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:36.004165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:36.004165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:36.004779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:36.004779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:36.008229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1053/2086] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:42.942724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:42.943324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:42.943324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:42.973877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] MFA Rules not processed for user `f35d508678b14f2583abf9ba5ae7fb91`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:42.975261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:43.048797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1034/2087] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:43.054628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.065254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d7786-77f8-4434-8716-124e1594935f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.070259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.071231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.071450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.071726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.072487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.074435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:43.226835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1054/2088] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:41:43 2021] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:41:43.232188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.245766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f7f5a-4496-405b-8e94-680f8660d06a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.303746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.304465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.310370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.310370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.310370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.310370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:43.451142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1035/2089] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:41:43 2021] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:43.456860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.467529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1792df-d6d4-4193-969b-6941990e8afe admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.472866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.473854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.474297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.474938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.475881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.477764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:43.493673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1055/2090] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:41:43.497544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.514976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3464-e361-487a-abef-dbb9a6453493 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.520527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.521634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.522560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.522560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] PATH_INFO: `/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee/users/40ff96bdc59246b6ae0d85bc2283651a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.554487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a73b7e0d3f94f5997106aaddb8cf5ee, user_id=40ff96bdc59246b6ae0d85bc2283651a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.557899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:43.820863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1036/2091] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:41:43 2021] PUT /identity/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee/users/40ff96bdc59246b6ae0d85bc2283651a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:43.825516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.849888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fa075-7f0e-47d4-8c18-979a5a0c0171 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.944114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.944870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.945101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.945436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.946169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.947800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8f42a-a6c3-4a55-814c-3704c0add5ef admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:43.967103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1056/2092] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:43 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:43.969445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:43.981957 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f2b96-f5fd-4ddb-b3d7-b70bafbf8dd6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:43.987023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:43.988120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:43.988319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:43.988602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] PATH_INFO: `/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee/users/40ff96bdc59246b6ae0d85bc2283651a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:43.990997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a73b7e0d3f94f5997106aaddb8cf5ee, user_id=40ff96bdc59246b6ae0d85bc2283651a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:43.996420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:44.012667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1037/2093] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:41:43 2021] PUT /identity/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee/users/40ff96bdc59246b6ae0d85bc2283651a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:46.274304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:46.274786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:46.274972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:46.353597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:46.355244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:46.437734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1057/2094] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:41:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 10 03:41:46.447516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:46.449773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:46.587603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cc5ec-6b10-441b-976a-c90cfe8e24e8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:46.602207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:46.617831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:46.618168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:46.618494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:46.647068 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:46.649168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd81bc-4fb9-4400-837b-4220cdfcd78f service swift] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:46.673866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1038/2095] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:41:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:41:48.533423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:48.540778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:48.717244 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd9e6a-6fb3-4aa7-a745-0515f6abccc2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:48.723601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:48.725194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:48.725662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:48.726093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] PATH_INFO: `/v3/users/1bd544cc9a99494f82f424da956e84e7` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:48.727529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd544cc9a99494f82f424da956e84e7)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:48.730776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:49.367145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd544cc9a99494f82f424da956e84e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:49.400421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd544cc9a99494f82f424da956e84e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:49.498739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd544cc9a99494f82f424da956e84e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:49.500322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd544cc9a99494f82f424da956e84e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:49.501215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd544cc9a99494f82f424da956e84e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:49.525570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1058/2096] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:41:48 2021] DELETE /identity/v3/users/1bd544cc9a99494f82f424da956e84e7 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:49.530803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:49.534461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:49.534461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:49.566851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:49.568075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:49.696880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1039/2097] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:49.705103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:49.707197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:49.780883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83e42d-25e3-4d92-9492-fafa682aba56 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:49.793055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:49.795270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:49.796787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:49.798284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:49.821699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:49.823669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de596aad-dbd1-4b83-9252-8a8e5f56a249 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:49.838883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1059/2098] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:50.555344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:50.557036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:50.587651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc6415-7c2b-48ff-8d1f-c58194933d2f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:50.594106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:50.595106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:50.595478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:50.595842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] PATH_INFO: `/v3/projects/2f0caf7ca180469f967a3d5c38c02bb7` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:50.597389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0caf7ca180469f967a3d5c38c02bb7)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:50.600071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:50.835325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0caf7ca180469f967a3d5c38c02bb7', 'request_id': 'req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:50.852789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0caf7ca180469f967a3d5c38c02bb7', 'request_id': 'req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:50.977414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0caf7ca180469f967a3d5c38c02bb7', 'request_id': 'req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:51.010212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] The token cache is being invalidate because project 2f0caf7ca180469f967a3d5c38c02bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:41:51.010507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:51.012876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e43ff9b2-9ef8-4bc8-9039-a5fc9eec037a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:41:51.016232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1040/2099] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:41:50 2021] DELETE /identity/v3/projects/2f0caf7ca180469f967a3d5c38c02bb7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:51.024162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.025107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.025582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.062541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:51.064168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:51.185394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1060/2100] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:51.188443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.188708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.189004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.215154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:51.216496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:51.228248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1041/2101] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:41:51.232725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.247297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae49b3c-fda3-4b06-b1b3-19b93df08dad None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.264169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.265761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.266062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.266347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.267172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:41:51.267475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.269136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:51.294594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1061/2102] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:41:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:41:51.301363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.314074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005c1a-c7f9-4068-ade8-806188223f40 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.321487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.322485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.322982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.323459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.324392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.326506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:51.444787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1042/2103] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:41:51 2021] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:51.449646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.464857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ab09-cbec-45c6-b879-ff044aa4c527 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.571730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.573134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.573877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.574481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.576055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.578728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:51.720801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1062/2104] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:41:51 2021] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:41:51.728354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.746688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776c0cf-eeee-46dc-8f3b-9c4bc08e9fa9 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.770138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.774021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.774907 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.775453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.777118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.785309 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:51.796884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1043/2105] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:51 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:51.808534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.850448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0ca8c-1456-461e-8572-8b3fe15524ce admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.868996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.869752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.870045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.870383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.871392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.873702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02d3fc-cee5-4d33-bc1f-23d280e93eb0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:51.888667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1063/2106] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:41:51 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:41:51.893787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:51.905581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5cd4a-cc9b-4df1-85eb-38f8d2186fa4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:51.912783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:51.913279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:51.913643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:51.914003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] PATH_INFO: `/v3/projects/36268b5e7f204441a3f0ef37d17a1359/users/3157dfcce1fa4002848aada9c0817a3c/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:51.934088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36268b5e7f204441a3f0ef37d17a1359, user_id=3157dfcce1fa4002848aada9c0817a3c, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:51.941384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:52.394193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1044/2107] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:41:51 2021] PUT /identity/v3/projects/36268b5e7f204441a3f0ef37d17a1359/users/3157dfcce1fa4002848aada9c0817a3c/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:41:52.419718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ddb6-ce47-4976-8747-3b1f1cc293b7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:52.420356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ddb6-ce47-4976-8747-3b1f1cc293b7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:52.420863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ddb6-ce47-4976-8747-3b1f1cc293b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:52.523600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7d11ddb6-ce47-4976-8747-3b1f1cc293b7 None None] MFA Rules not processed for user `3157dfcce1fa4002848aada9c0817a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:52.533317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7d11ddb6-ce47-4976-8747-3b1f1cc293b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:52.786389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1064/2108] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:52 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:52.832964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:52.839948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:53.118802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd33bf-9200-4739-b0da-2be1abe76649 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:53.127670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:53.129526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:53.129526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:53.129526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:53.172949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:53.175273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:53.202727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1045/2109] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:52 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:41:53.600106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5900-5cb6-46b9-8c19-ee2df72e2b16 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:53.600998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5900-5cb6-46b9-8c19-ee2df72e2b16 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:53.609202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc5900-5cb6-46b9-8c19-ee2df72e2b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:53.654170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1cdc5900-5cb6-46b9-8c19-ee2df72e2b16 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:53.656889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1cdc5900-5cb6-46b9-8c19-ee2df72e2b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:53.819899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1065/2110] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:41:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:41:53.828783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:53.831048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:54.129067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de627f-555e-42fa-89c0-9bd4d1827cb5 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:54.158510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:54.160335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:54.205946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:54.205946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:54.317187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:54.320086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:54.379988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1046/2111] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:41:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 03:41:54.876368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0e61-fe7a-4179-b26c-71ada7ee7945 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:54.877535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0e61-fe7a-4179-b26c-71ada7ee7945 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:54.877979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0e61-fe7a-4179-b26c-71ada7ee7945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:54.983768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-43cd0e61-fe7a-4179-b26c-71ada7ee7945 None None] MFA Rules not processed for user `40ff96bdc59246b6ae0d85bc2283651a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:41:54.986448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-43cd0e61-fe7a-4179-b26c-71ada7ee7945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:55.150842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1066/2112] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:41:54 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:41:55.163787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:41:55.168286 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:55.420922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e6d00-51b1-4e8f-9535-d2126a179290 service swift] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:41:55.438083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:41:55.439111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:41:55.443481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:41:55.443974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:41:55.451616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:41:55.677134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:41:55.685264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e630f-bcd8-4fa9-9fa2-4e8ae596472b service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:41:55.708538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1047/2113] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:41:55 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:02.814999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726df6-caca-4bca-9b78-c39a7a5ed3d5 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:02.815797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726df6-caca-4bca-9b78-c39a7a5ed3d5 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:02.815797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726df6-caca-4bca-9b78-c39a7a5ed3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:02.939696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2f726df6-caca-4bca-9b78-c39a7a5ed3d5 None None] MFA Rules not processed for user `f35d508678b14f2583abf9ba5ae7fb91`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:02.943795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2f726df6-caca-4bca-9b78-c39a7a5ed3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:03.003266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1067/2114] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:02 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:18.103285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:18.104420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:18.104885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] PATH_INFO: `/` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:18.107285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1048/2115] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:42:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:42:18.119243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cc34-9259-4179-b9c3-c41680a9eb38 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:18.119789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cc34-9259-4179-b9c3-c41680a9eb38 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:18.119918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449cc34-9259-4179-b9c3-c41680a9eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:18.159846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9449cc34-9259-4179-b9c3-c41680a9eb38 None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:18.161105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9449cc34-9259-4179-b9c3-c41680a9eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:18.170774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1068/2116] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:42:18 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:27.437673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:27.439082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:27.521258 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794d0b-0ffa-4b4e-9770-6d91cd2677e1 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:27.525880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:27.526816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:27.527187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:27.527483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:27.539505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:27.541006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20866e16-bd3d-4508-a9c4-9b59824b12fa service glance] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:27.552071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1049/2117] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:27 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:27.899397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:27.900341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:27.900587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:27.903035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1069/2118] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:42:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:42:27.908493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b3bd-fbdb-4d40-b7f2-dc80909381d3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:27.908787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b3bd-fbdb-4d40-b7f2-dc80909381d3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:27.909077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696b3bd-fbdb-4d40-b7f2-dc80909381d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:27.926438 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a696b3bd-fbdb-4d40-b7f2-dc80909381d3 None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:27.927625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a696b3bd-fbdb-4d40-b7f2-dc80909381d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:27.977231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1050/2119] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:42:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:42:27.990993 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:27.992739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:28.006048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a5060-2977-4bfb-9e0d-a314ddcda896 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:28.012093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:28.012093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:28.012093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:28.012093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:28.017601 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:28.019168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:28.028090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1070/2120] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:28.643844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:28.644425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:28.644532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:28.714283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:28.715582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:28.732931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1051/2121] 10.222.0.21 () {58 vars in 968 bytes} [Tue Aug 10 03:42:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:28.758591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:28.804236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982006e6-2a42-4cf1-a859-f43a68687949 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:28.810086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:28.813791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:28.813791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:28.813791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:28.821429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:28.822977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bcd3e-4dd6-4611-b299-a11f2433bb02 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:28.854852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1071/2122] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:42:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:42:29.769187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:29.770619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:29.859292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1944a4-b155-444f-8617-0f92d9d18b81 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:29.865266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:29.865921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:29.866207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:29.866485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:29.868275 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:29.881475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:29.883443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:29.894981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1052/2123] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:29 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:33.156934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:33.157426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:33.157519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:33.176994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:33.178148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:33.186343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1072/2124] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:42:33 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:33.199176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:33.211694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0b52-55f8-415f-ba77-9c9621fe94c9 service placement] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:33.216933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:33.217578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:33.217865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:33.218147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:33.226465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:33.228046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:33.237522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1053/2125] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:42:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 03:42:33.870220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:33.871931 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:33.979886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd7e94-3e8e-409e-af63-5ef040ce11ef None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:33.990266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:33.991413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:33.992138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:33.992703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] PATH_INFO: `/v3/users/84491dcbe2d1410a8d7557538c91c204` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:33.994677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84491dcbe2d1410a8d7557538c91c204)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:34.000526 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:34.326226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84491dcbe2d1410a8d7557538c91c204'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.337691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84491dcbe2d1410a8d7557538c91c204'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.410127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84491dcbe2d1410a8d7557538c91c204'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.410793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84491dcbe2d1410a8d7557538c91c204'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.411988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a43c7692-2913-4570-ab3e-62e9a64f341c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84491dcbe2d1410a8d7557538c91c204'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.427183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1073/2126] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:42:33 2021] DELETE /identity/v3/users/84491dcbe2d1410a8d7557538c91c204 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:42:34.692687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:34.710345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd71c-cd3f-4bc3-a085-2fa52db2dba1 service swift] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:34.780085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:34.781127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:34.781446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:34.781730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] PATH_INFO: `/v3/projects/46fb8b2b63114fd68f07ec997a49a162` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:34.783003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fb8b2b63114fd68f07ec997a49a162)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:34.784960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:34.927583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fb8b2b63114fd68f07ec997a49a162', 'request_id': 'req-fc2da413-6f5b-4f38-befb-45b866fd39b3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:34.934781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fb8b2b63114fd68f07ec997a49a162', 'request_id': 'req-fc2da413-6f5b-4f38-befb-45b866fd39b3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:35.010135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fb8b2b63114fd68f07ec997a49a162', 'request_id': 'req-fc2da413-6f5b-4f38-befb-45b866fd39b3'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:35.021855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] The token cache is being invalidate because project 46fb8b2b63114fd68f07ec997a49a162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:42:35.022194 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:35.022920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fc2da413-6f5b-4f38-befb-45b866fd39b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:35.029542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1054/2127] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:42:34 2021] DELETE /identity/v3/projects/46fb8b2b63114fd68f07ec997a49a162 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:35.031126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.031426 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.031717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.051700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:35.052949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:35.155252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1074/2128] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:42:35.161265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.161657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.162663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.189000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:35.190152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:35.211099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1055/2129] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:42:35.215187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.229651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7437ac-7be3-4596-8bfc-55a9f93f6a00 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.236221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.237230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.237580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.237921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.242616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:42:35.242616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.242616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.257905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1075/2130] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:42:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:42:35.265581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.276065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133a898-80fb-470a-bb32-c0a0cd17fdf3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.281133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.281809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.282407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.282846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.283556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.285570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.398404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1056/2131] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:42:35 2021] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:42:35.404725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.415635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd4de-e0c7-49c4-a0a1-55eb65ad7eb2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.475432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.476109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.476455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.476737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.477434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.479453 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.660337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1076/2132] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:42:35 2021] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:42:35.661682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.671762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a4f4-0599-43c9-9ef9-5ec988d9a51a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.676756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.677557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.677845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.678129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.678862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.680543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.694648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1057/2133] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:35 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:35.697828 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.722220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955ef8d-632d-4236-9d5e-5cac0fadd073 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.722220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.722220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.722220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.722755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.722755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.722755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52249ffb-348d-45fa-b2fb-4ba88ae32d44 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.730972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1077/2134] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:35 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:35.735791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.748591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f19b9-0562-4fb0-b3cd-21cf83864b0f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:35.757066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:35.758011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.758345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.758687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] PATH_INFO: `/v3/projects/2ce125c05e8d4cb99302437ab92ffd2c/users/f2206fc1fcde4dc4bc9dd24c016c2dbf/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.777333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce125c05e8d4cb99302437ab92ffd2c, user_id=f2206fc1fcde4dc4bc9dd24c016c2dbf, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:35.782064 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:35.892058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1058/2135] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:42:35 2021] PUT /identity/v3/projects/2ce125c05e8d4cb99302437ab92ffd2c/users/f2206fc1fcde4dc4bc9dd24c016c2dbf/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:42:35.897462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551a82-47dc-4650-823c-16c1db92a325 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:35.897758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551a82-47dc-4650-823c-16c1db92a325 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:35.898040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551a82-47dc-4650-823c-16c1db92a325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:35.915358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e3551a82-47dc-4650-823c-16c1db92a325 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:35.916606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e3551a82-47dc-4650-823c-16c1db92a325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:35.986668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1078/2136] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:35.993093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:35.995026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:36.063707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e7c18-24c0-424a-a2cf-5c38572704e8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:36.076640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:36.077541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:36.077826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:36.078102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:36.096222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:36.097700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:36.108292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1059/2137] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:38.708625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb0c4-808c-4cf9-bb25-a9d1addd228d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:38.709197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb0c4-808c-4cf9-bb25-a9d1addd228d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:38.709197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eb0c4-808c-4cf9-bb25-a9d1addd228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:38.764409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4a5eb0c4-808c-4cf9-bb25-a9d1addd228d None None] MFA Rules not processed for user `f2206fc1fcde4dc4bc9dd24c016c2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:38.765943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4a5eb0c4-808c-4cf9-bb25-a9d1addd228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:38.860253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1079/2138] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:38 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:38.870906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:38.873079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:38.973220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474aada-155f-4959-aea2-1c35d2d36584 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:38.973220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:38.973220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:38.973220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:38.974285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:38.974285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:38.974285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:38.980659 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1060/2139] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:38 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:41.835653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:41.837104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:41.837104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:41.857636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] MFA Rules not processed for user `f2206fc1fcde4dc4bc9dd24c016c2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:41.858847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:41.866611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1080/2140] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:41 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:50.947720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:50.949691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:50.964579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b5c98-a3f4-4e29-94ab-99eb4673a9e4 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:50.969568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:50.970449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:50.970742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:50.971022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] PATH_INFO: `/v3/users/cb4a0eaef1ba4df5a07bda5bef95dd99` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:50.972589 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4a0eaef1ba4df5a07bda5bef95dd99)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:50.974560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:51.248849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4a0eaef1ba4df5a07bda5bef95dd99'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.249615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4a0eaef1ba4df5a07bda5bef95dd99'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.250245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4a0eaef1ba4df5a07bda5bef95dd99'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.264126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4a0eaef1ba4df5a07bda5bef95dd99'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.276814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a2da5bf2-63ac-4134-9b12-5bc3657db825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4a0eaef1ba4df5a07bda5bef95dd99'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.410287 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1061/2141] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:42:50 2021] DELETE /identity/v3/users/cb4a0eaef1ba4df5a07bda5bef95dd99 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:51.703215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:51.714546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63739-c1ff-4dbc-8d83-3d0cefc5ddb0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:51.771055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:51.771922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:51.772215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:51.772521 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] PATH_INFO: `/v3/projects/0218bd23bab4457abfb072f168e61af6` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:51.773731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0218bd23bab4457abfb072f168e61af6)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:51.775673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:51.963706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0218bd23bab4457abfb072f168e61af6', 'request_id': 'req-e0c4998c-aa0b-4605-948f-8440bf480561'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.969447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0218bd23bab4457abfb072f168e61af6', 'request_id': 'req-e0c4998c-aa0b-4605-948f-8440bf480561'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:51.975702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0218bd23bab4457abfb072f168e61af6', 'request_id': 'req-e0c4998c-aa0b-4605-948f-8440bf480561'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:52.086648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] The token cache is being invalidate because project 0218bd23bab4457abfb072f168e61af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:42:52.087087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:52.088051 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e0c4998c-aa0b-4605-948f-8440bf480561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:52.090438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1081/2142] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:42:51 2021] DELETE /identity/v3/projects/0218bd23bab4457abfb072f168e61af6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:52.101534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.102219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.102648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.129264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:52.130815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:52.190456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1062/2143] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:52.198333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.198709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.199027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.218297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:52.219436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:52.227556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1082/2144] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:52.232791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.243032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f0b3e-7847-49ae-8280-676be669cd84 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.248310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.248971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.249312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.249526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.250324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:42:52.250620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.252232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.264030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1063/2145] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:42:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:42:52.268523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.277689 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e010415-0ef1-4e94-96b0-a749f588c6e9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.282423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.283078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.283364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.283638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.284353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.286253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.391900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1083/2146] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:42:52 2021] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:42:52.393019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.404096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70a63d-6ca2-47ac-af62-6cc727fe3585 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.483305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.484538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.490421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.490421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.490421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.490421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.637732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1064/2147] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:42:52 2021] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:42:52.642006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.664365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bc3d-4da0-417b-aa6d-fe1df7c70360 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.674182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.675428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.676044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.676948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.690117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.690117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.696723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1084/2148] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:52 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:52.700677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.710829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f4be7-4d67-4508-bb7f-5152789217fb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.715794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.716741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.720931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.720931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.720931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.720931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99dc8b-2d9c-4936-87e5-4771a2f779ab admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.734006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1065/2149] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:52.738088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:52.749602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5f31-a404-483a-8274-7a611064cb51 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:52.755224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:52.756257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.756624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.757241 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] PATH_INFO: `/v3/projects/db6f6d82e73d4d698663466005fe408c/users/070ee25c6e3a40199623213e46e64405/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.773884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6f6d82e73d4d698663466005fe408c, user_id=070ee25c6e3a40199623213e46e64405, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:52.776704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:52.950846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1085/2150] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:42:52 2021] PUT /identity/v3/projects/db6f6d82e73d4d698663466005fe408c/users/070ee25c6e3a40199623213e46e64405/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:52.960979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:52.961369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:52.961732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:52.992782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] MFA Rules not processed for user `070ee25c6e3a40199623213e46e64405`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:52.994202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:53.069147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1066/2151] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:42:53.081209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:53.083080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:53.157128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9b33-4b5a-4746-8ab1-bde730d99889 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:53.163474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:53.163981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:53.164167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:53.164723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:53.172964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:53.174618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e1eab-8467-4547-a4de-263665c25633 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:53.184179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1086/2152] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:53 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:56.403872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:56.405353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:56.469832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2f010-647c-4a87-bdc7-62c63040f9a5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:56.474581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:56.475483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:56.475770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:56.476078 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] PATH_INFO: `/v3/users/3157dfcce1fa4002848aada9c0817a3c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:56.477306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3157dfcce1fa4002848aada9c0817a3c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:56.479335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:56.708116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3157dfcce1fa4002848aada9c0817a3c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:56.708727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3157dfcce1fa4002848aada9c0817a3c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:56.709337 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3157dfcce1fa4002848aada9c0817a3c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:56.715990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3157dfcce1fa4002848aada9c0817a3c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:56.727239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3157dfcce1fa4002848aada9c0817a3c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:56.826584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1067/2153] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:42:56 2021] DELETE /identity/v3/users/3157dfcce1fa4002848aada9c0817a3c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:56.831337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:56.831804 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:56.831918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:56.848505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:56.849685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:56.905141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1087/2154] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:56.914802 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:56.916256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:56.972230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ab85e-214f-4928-ac62-34433e1da0df admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:56.975723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:56.976397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:56.976678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:56.976953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:56.987132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:56.988591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412a61-0b4b-49ce-99da-434611871eca service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:56.997901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1068/2155] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:42:57.442945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:57.444446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:57.456824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf038f74-a2c1-41c7-b176-05d6317f8f2d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:57.462088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:57.462962 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:57.463246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:57.463520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] PATH_INFO: `/v3/projects/36268b5e7f204441a3f0ef37d17a1359` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:57.464757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36268b5e7f204441a3f0ef37d17a1359)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:57.466686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:57.604058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36268b5e7f204441a3f0ef37d17a1359', 'request_id': 'req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:57.611289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36268b5e7f204441a3f0ef37d17a1359', 'request_id': 'req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:57.617794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36268b5e7f204441a3f0ef37d17a1359', 'request_id': 'req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:57.706005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] The token cache is being invalidate because project 36268b5e7f204441a3f0ef37d17a1359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:42:57.706295 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:57.706916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7f4b1239-02ce-41df-8a9e-2e6101cb1b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:42:57.708504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1088/2156] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:42:57 2021] DELETE /identity/v3/projects/36268b5e7f204441a3f0ef37d17a1359 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:57.714135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:57.714605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:57.714713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:57.732342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:57.733474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:57.789727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1069/2157] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:57.797898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:57.798189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:57.798477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:57.816807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:57.818005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:57.825893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1089/2158] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:42:57.836831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:57.846591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8c007-40df-4e48-8c84-90789893d3c9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:57.851289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:57.851936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:57.852244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:57.852529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:57.853248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:42:57.853635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:57.855231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:57.867120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1070/2159] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:42:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:42:57.871182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:57.880832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbccf4-d187-4245-b5ec-860d80a7d504 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:57.885531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:57.886169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:57.886451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:57.886727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:57.887402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:57.889329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:57.983006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1090/2160] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:42:57 2021] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:42:57.987332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:57.997928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeb35d-7f87-437d-92ab-be151213437e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:58.052714 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:58.053371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.053655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.053931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.054600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:58.056517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:58.158667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1071/2161] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:42:57 2021] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:42:58.162899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:58.173731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4dad8-aa1c-49b8-805d-8280afadc038 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:58.178479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:58.179135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.179424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.179702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.180456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:58.182044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:58.195612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1091/2162] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:58.196720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:58.206539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66927240-360a-4d37-9490-d141ebf45c2d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:58.211236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:58.211895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.212181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.212497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.213246 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:58.214851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d2edb-5962-43f8-9073-8af68ee3ed66 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:58.226934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1072/2163] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:42:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:42:58.231042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:58.242612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42574fb-8ccf-4f1e-933c-9803ed7258cb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:58.247272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:58.248343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.248651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.249101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] PATH_INFO: `/v3/projects/ea7ada6602c941cca64291972a146a82/users/2c774311ed4840208676dc7b3b26f809/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.264108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7ada6602c941cca64291972a146a82, user_id=2c774311ed4840208676dc7b3b26f809, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:58.269738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:58.387067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1092/2164] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:42:58 2021] PUT /identity/v3/projects/ea7ada6602c941cca64291972a146a82/users/2c774311ed4840208676dc7b3b26f809/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:42:58.398608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b665-4fc4-47ac-8686-394dab785f42 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.398905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b665-4fc4-47ac-8686-394dab785f42 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.399186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41b665-4fc4-47ac-8686-394dab785f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.439550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ca41b665-4fc4-47ac-8686-394dab785f42 None None] MFA Rules not processed for user `2c774311ed4840208676dc7b3b26f809`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:42:58.440877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ca41b665-4fc4-47ac-8686-394dab785f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:58.512183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1073/2165] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:42:58 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:42:58.522115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:42:58.523938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:42:58.593409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4244303-453d-4637-aa2a-ccd263360eb3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:42:58.597384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:42:58.598047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:42:58.598351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:42:58.598636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:42:58.608099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:42:58.609837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:42:58.619534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1093/2166] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:42:58 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:00.422293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:00.422758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:00.422865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:00.440612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:00.441799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:00.499716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1074/2167] 10.222.0.21 () {58 vars in 968 bytes} [Tue Aug 10 03:43:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:00.512842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:00.514679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:00.609402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4fd1c-4662-4f3f-9c0e-a5b2bafe5434 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:00.614737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:00.615398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:00.615687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:00.615970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:00.625359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:00.627061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cccc3-71bd-45ed-96e3-7c13aa79dd08 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:00.635941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1094/2168] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:43:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:05.765153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:05.767196 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:05.834687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce3568-a969-418b-831f-2e5b2055bd5a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:05.839285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:05.840147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:05.840469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:05.840750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] PATH_INFO: `/v3/users/070ee25c6e3a40199623213e46e64405` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:05.841973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070ee25c6e3a40199623213e46e64405)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:05.843905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:06.075254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070ee25c6e3a40199623213e46e64405'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:06.075943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070ee25c6e3a40199623213e46e64405'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:06.076612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070ee25c6e3a40199623213e46e64405'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:06.085076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070ee25c6e3a40199623213e46e64405'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:06.097547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070ee25c6e3a40199623213e46e64405'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:06.176062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1075/2169] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:05 2021] DELETE /identity/v3/users/070ee25c6e3a40199623213e46e64405 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:06.185247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:06.186070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:06.186351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:06.203628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:06.204853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:06.259865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1095/2170] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:06.270594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:06.271977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:06.332164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4cb0-4d67-4531-9cdc-81a54a3cb399 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:06.335964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:06.336650 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:06.336932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:06.337205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:06.346151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:06.347710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f9607-32d8-4e9f-a875-84cf51887e88 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:06.356947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1076/2171] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:06.891319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:06.897282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:06.905978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab8f6d-2588-4d4a-b6ec-5c3078faaa09 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:06.911697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:06.912757 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:06.913041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:06.913316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] PATH_INFO: `/v3/projects/db6f6d82e73d4d698663466005fe408c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:06.914622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6f6d82e73d4d698663466005fe408c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:06.916662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.049644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6f6d82e73d4d698663466005fe408c', 'request_id': 'req-85f1a246-4467-4a86-b305-a5a6887324fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:07.055253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6f6d82e73d4d698663466005fe408c', 'request_id': 'req-85f1a246-4467-4a86-b305-a5a6887324fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:07.064103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6f6d82e73d4d698663466005fe408c', 'request_id': 'req-85f1a246-4467-4a86-b305-a5a6887324fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:07.134638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] The token cache is being invalidate because project db6f6d82e73d4d698663466005fe408c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:07.134929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:07.135545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-85f1a246-4467-4a86-b305-a5a6887324fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:07.137127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1096/2172] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:06 2021] DELETE /identity/v3/projects/db6f6d82e73d4d698663466005fe408c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:07.145062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.145583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.145702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.163317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:07.164623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:07.227394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1077/2173] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:07.236464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.237226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.237322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.256696 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:07.257991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:07.266224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1097/2174] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:07.270627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.280693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e696e-ff5c-4add-ba02-8ed342fffcd3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.285416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.286070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.286354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.286634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.287362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:07.287670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.289348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.301253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1078/2175] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:43:07.305632 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.317288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4310e-962d-4054-be5d-d7c747a5ae0b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.324150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.324880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.325792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.326080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.326851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.328964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.410699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1098/2176] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:07 2021] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:07.415124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.425851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f77-f845-4e4d-9318-20383022790b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.484320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.484985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.485271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.485550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.486242 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.488136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.575356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1079/2177] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:07 2021] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:07.579734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.590494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28c431-95bd-4d49-8405-e1aeab87c171 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.595404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.596064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.596397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.600434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.600434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.600434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.611928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1099/2178] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:07.615212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.626382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c4b0-f1fe-47b6-ac60-513f94c75ddb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.631128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.631783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.632723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.632723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.633121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.634693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91535c4d-f660-48f5-900b-fcdb4bee21f7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.645001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1080/2179] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:07.649893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.660078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed5a5b-1c85-44c1-ace5-6ea1be9d9a98 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.664789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.665660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.665947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.666221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] PATH_INFO: `/v3/projects/6ce9f312551643b6a7bfa610be56d4fc/users/edf559d06df04dc68cb6aac4e03c9585/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.680799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce9f312551643b6a7bfa610be56d4fc, user_id=edf559d06df04dc68cb6aac4e03c9585, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.683435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.769998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1100/2180] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:07 2021] PUT /identity/v3/projects/6ce9f312551643b6a7bfa610be56d4fc/users/edf559d06df04dc68cb6aac4e03c9585/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:07.780800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.781102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.781410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.808835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] MFA Rules not processed for user `edf559d06df04dc68cb6aac4e03c9585`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:07.810451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:07.874572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1081/2181] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:07 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:07.884367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:07.886260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:07.948079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0289e80-b17e-4d79-b168-734a93266d65 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:07.952448 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:07.953089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:07.953370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:07.953642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:07.962460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:07.964095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:07.973645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1101/2182] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:07 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:16.345021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:16.346490 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:16.407854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36885953-25b9-4874-8549-863cb5dd6bb9 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:16.411719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:16.412399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:16.412686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:16.412964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:16.414709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:16.477869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:16.479342 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7760-17a3-4c5f-ada5-50ab0f3910e6 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:16.491208 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1082/2183] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:16 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:43:21.267902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:21.269450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:21.333118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b298ffd-91ba-4c84-85bb-c4f4ef2ef0be service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:21.338067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:21.338998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:21.339327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:21.339653 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] PATH_INFO: `/v3/users/2c774311ed4840208676dc7b3b26f809` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:21.341697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c774311ed4840208676dc7b3b26f809)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:21.343890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:21.524900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c774311ed4840208676dc7b3b26f809'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:21.537151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c774311ed4840208676dc7b3b26f809'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:21.609883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c774311ed4840208676dc7b3b26f809'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:21.610560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c774311ed4840208676dc7b3b26f809'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:21.611871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c774311ed4840208676dc7b3b26f809'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:21.625338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1102/2184] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:21 2021] DELETE /identity/v3/users/2c774311ed4840208676dc7b3b26f809 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:21.630065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:21.630715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:21.630715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:21.648022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:21.649261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:21.707941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1083/2185] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:21.719192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:21.720942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:21.791042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b52bdb-403b-4bf0-925f-1a5763607919 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:21.794992 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:21.795648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:21.796008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:21.796321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:21.806065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:21.807568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab74cd0-46be-4b5c-b856-301e887d8be4 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:21.817493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1103/2186] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:43:22.462026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:22.466260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:22.477546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d765e8-8c1c-4d89-afc6-0a46b0257372 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:22.483186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:22.484621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:22.484909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:22.492727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] PATH_INFO: `/v3/projects/ea7ada6602c941cca64291972a146a82` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:22.494146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7ada6602c941cca64291972a146a82)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:22.496031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:22.651281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7ada6602c941cca64291972a146a82', 'request_id': 'req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:22.658191 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7ada6602c941cca64291972a146a82', 'request_id': 'req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:22.774807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7ada6602c941cca64291972a146a82', 'request_id': 'req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:22.791841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] The token cache is being invalidate because project ea7ada6602c941cca64291972a146a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:22.792132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:22.793151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cf6d73a0-d46d-432a-9aa2-a8d72001ab4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:22.794945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1084/2187] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:22 2021] DELETE /identity/v3/projects/ea7ada6602c941cca64291972a146a82 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:22.801023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:22.801533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:22.801668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:22.819519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:22.820815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:22.880805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1104/2188] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:22.889167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:22.889465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:22.889748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:22.910611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:22.911853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:22.920598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1085/2189] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:22.926925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:22.937905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b16712-0292-4089-a1d2-6ab108d48235 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:22.944291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:22.945009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:22.945367 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:22.945761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:22.946691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:22.947292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:22.948932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:22.964237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1105/2190] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:22.968727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:22.979666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749edfeb-6522-4228-ba4d-d83248e6657d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:22.985767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:22.986683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:22.986983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:22.987508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:22.988398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:22.990644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.088676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1086/2191] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:22 2021] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:23.093518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.108457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b5243-45d7-41ee-9a76-9bf884f30fef admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.182327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.183102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.183396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.183901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.185495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.195782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.341881 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1106/2192] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:23 2021] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:23.346128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.356970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a64f-ab5d-4e85-85ab-1f2c9bb3c70b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.363977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.364717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.365009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.365292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.366042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.367841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.382158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1087/2193] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:23.383657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.397452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506837e-0e9a-47ff-9428-9101e9442cf8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.400382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.401077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.401365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.401645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.402386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.404616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.415524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1107/2194] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:23.419904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.430210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72931d2-25e5-411e-833b-ea3912455fd1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.435095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.436004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.436344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.436630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] PATH_INFO: `/v3/projects/a2ebcc2259864e7b91ab0fe1190f0f2e/users/79bc1be4a0e5421aa5e8c2792f7fb05a/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.451415 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.453271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:23.457549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ebcc2259864e7b91ab0fe1190f0f2e, user_id=79bc1be4a0e5421aa5e8c2792f7fb05a, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.460230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a300021-8f07-4ed8-a233-2d58457fbae7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.466919 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087eee4-c029-4116-bec6-964ba0527e15 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.472245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.473118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.475081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.475081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] PATH_INFO: `/v3/users/edf559d06df04dc68cb6aac4e03c9585` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.475081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf559d06df04dc68cb6aac4e03c9585)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.476948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.574805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1088/2195] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:23 2021] PUT /identity/v3/projects/a2ebcc2259864e7b91ab0fe1190f0f2e/users/79bc1be4a0e5421aa5e8c2792f7fb05a/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:23.580349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.580660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.580928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.601086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:23.602760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:23.665401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1089/2196] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:23.675604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:23.677207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:23.739689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb46f38-c31e-4728-af56-628998d1c14e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:23.743568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:23.744259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.744610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.744893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.756046 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf559d06df04dc68cb6aac4e03c9585'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:23.756332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:23.757906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747c6fa-eb49-4f15-9257-b1b4908d70dc service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:23.769405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1090/2197] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:43:23.776287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf559d06df04dc68cb6aac4e03c9585'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:23.906279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf559d06df04dc68cb6aac4e03c9585'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:23.914026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf559d06df04dc68cb6aac4e03c9585'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:23.914026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf559d06df04dc68cb6aac4e03c9585'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:23.927815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1108/2198] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:23 2021] DELETE /identity/v3/users/edf559d06df04dc68cb6aac4e03c9585 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:23.932134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:23.932457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:23.932740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:23.962089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:23.963396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:24.032853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1091/2199] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:24.043111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:24.044704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:24.117213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb183b-398b-4957-a044-b3cdad7f3de2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:24.121810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:24.122618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:24.123043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:24.123329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:24.134583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:24.136184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de120e96-5694-4d31-9e22-e19a66a29530 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:24.158568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1109/2200] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:25.029564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:25.036497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:25.093009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05696d8-2622-4c59-aa27-43babc0b4c4d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:25.109512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:25.109512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:25.109512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:25.109512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] PATH_INFO: `/v3/projects/6ce9f312551643b6a7bfa610be56d4fc` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:25.114031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce9f312551643b6a7bfa610be56d4fc)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:25.116544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:25.303810 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce9f312551643b6a7bfa610be56d4fc', 'request_id': 'req-5f3df1b4-378f-4295-9e77-a2ac74365222'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:25.311428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce9f312551643b6a7bfa610be56d4fc', 'request_id': 'req-5f3df1b4-378f-4295-9e77-a2ac74365222'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:25.386257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce9f312551643b6a7bfa610be56d4fc', 'request_id': 'req-5f3df1b4-378f-4295-9e77-a2ac74365222'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:25.410179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] The token cache is being invalidate because project 6ce9f312551643b6a7bfa610be56d4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:25.413746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:25.416497 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-5f3df1b4-378f-4295-9e77-a2ac74365222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:25.420161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1092/2201] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:25 2021] DELETE /identity/v3/projects/6ce9f312551643b6a7bfa610be56d4fc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:25.425752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:25.426668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:25.427050 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:25.447766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:25.449147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:25.524382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1110/2202] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:25.538624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:25.538624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:25.538624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:25.565520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:25.568413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:25.583936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:25.591019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1093/2203] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:25.600871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b7aa8-7437-449e-9ff9-b2b5a7203dc2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:25.607916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:25.609485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:25.610103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:25.610650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:25.611607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:25.612186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:25.614384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:25.633639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:25.641222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1111/2204] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:25.646912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4651de-e3f0-46b0-974d-2bab236cb134 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:25.652479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:25.653540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:25.654230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:25.654879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:25.655804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:25.679848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.022625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1094/2205] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:25 2021] POST /identity/v3/projects => generated 381 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:26.026882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.037853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3162b59-680c-4272-8d81-fc7d8f62b7f4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.121985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.123827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.124107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.124442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.125150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.127103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.244340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1112/2206] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:26 2021] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:26.245031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.258456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e06d-cd47-445d-8b2a-30b04ecdd2ff admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.271887 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.272863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.273297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.273741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.274627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.277009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.313484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1095/2207] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:26 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:26.315106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.327775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa7e9-6aac-4d17-90b7-e9531fd71a38 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.333154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.333806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.334088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.334597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.335324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.336970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc83c4-8b3f-4b19-8140-7fd65d173e0a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.347814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1113/2208] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:26.353785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.368380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f3ef-32c2-4ba0-866b-67973d291871 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.375365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.376576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.377056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.377632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] PATH_INFO: `/v3/projects/8c210bcd02904f7aa924aae8ef2d8f32/users/d930e8d6eebb4541810739cc4b99171a/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.400552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c210bcd02904f7aa924aae8ef2d8f32, user_id=d930e8d6eebb4541810739cc4b99171a, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.404833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.506038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1096/2209] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:26 2021] PUT /identity/v3/projects/8c210bcd02904f7aa924aae8ef2d8f32/users/d930e8d6eebb4541810739cc4b99171a/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:26.522483 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.522970 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.523066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.553139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] MFA Rules not processed for user `d930e8d6eebb4541810739cc4b99171a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:26.554496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:26.647544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.652285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1114/2210] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:26 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:26.790737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebb84-b337-4662-b2f9-27f3410294c1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.796968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.797649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.797940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.798219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.799077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.801294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:26.906020 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1097/2211] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:26 2021] POST /identity/v3/projects => generated 381 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:26.907200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.918219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261b3df-c03c-4821-89cc-c02d44718757 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:26.980585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:26.982462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:26.986236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:26.987006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:26.987360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:26.987784 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:26.988694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:26.990878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.001784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de78af-9f4c-4065-85f3-c8dcbc57a130 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.003233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.004420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.004708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.004986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] PATH_INFO: `/v3/users/f4e6c08307964f198aa7efc7961aa09f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.006227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e6c08307964f198aa7efc7961aa09f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.008154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.078600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1115/2212] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:26 2021] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:27.082591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.093844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1794dc-003c-4532-b1d9-eecebcfe983d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.098634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.099438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.099751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.099982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.101089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.102781 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.122400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1116/2213] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:27 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:27.123545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.134089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf9857-b43b-4241-b4a5-1da3e0a508e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.140037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.141041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.141400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.141772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] PATH_INFO: `/v3/projects/b61a89f949c54dfbac4eab051f3ac544/users/602c9d2fe46b40a999e1ab127c48e7d0/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.159950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61a89f949c54dfbac4eab051f3ac544, user_id=602c9d2fe46b40a999e1ab127c48e7d0, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.162720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.203007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e6c08307964f198aa7efc7961aa09f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:27.203723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e6c08307964f198aa7efc7961aa09f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:27.204387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e6c08307964f198aa7efc7961aa09f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:27.211926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e6c08307964f198aa7efc7961aa09f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:27.228481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e6c08307964f198aa7efc7961aa09f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:27.244111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1117/2214] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:27 2021] PUT /identity/v3/projects/b61a89f949c54dfbac4eab051f3ac544/users/602c9d2fe46b40a999e1ab127c48e7d0/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:27.248673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.250646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:27.317802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5793e-9318-460d-b97f-c07e222836f8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.322909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.323606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.323884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.324156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.325035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.327147 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55deabcb-70ac-416e-b526-d0e243df4e40 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.343953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1098/2215] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:26 2021] DELETE /identity/v3/users/f4e6c08307964f198aa7efc7961aa09f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:27.344835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1118/2216] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:27 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:27.348676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.429118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf45d0b-9ac1-42fd-b4a1-cab2bd645631 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.435869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.436825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.437114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.437392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] PATH_INFO: `/v3/projects/b61a89f949c54dfbac4eab051f3ac544/users/602c9d2fe46b40a999e1ab127c48e7d0/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.439567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61a89f949c54dfbac4eab051f3ac544, user_id=602c9d2fe46b40a999e1ab127c48e7d0, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.442423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.453510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1099/2217] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:27 2021] PUT /identity/v3/projects/b61a89f949c54dfbac4eab051f3ac544/users/602c9d2fe46b40a999e1ab127c48e7d0/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:27.463474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.463846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.464230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.498326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] MFA Rules not processed for user `602c9d2fe46b40a999e1ab127c48e7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:27.499739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:27.595439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1119/2218] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:27 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:27.608944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.610737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:27.693428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a4e6f-4670-459f-8721-359f537cb18c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.697320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.697989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.698283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.698583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.709396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.710909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcbc83-bda1-4715-8f14-c5cfe6b63595 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:27.722033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1100/2219] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:27 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:27.804901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:27.806878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:27.886480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71693-9ce7-4eb0-9d02-fe2b39066cea None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:27.891903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:27.892751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:27.893208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:27.893490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] PATH_INFO: `/v3/projects/05aa352203a74307bd3b6157f78f6b97` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:27.894684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05aa352203a74307bd3b6157f78f6b97)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:27.896635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.025809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05aa352203a74307bd3b6157f78f6b97', 'request_id': 'req-1e53819f-18d1-4cb5-af4b-32b66dff864d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:28.032151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05aa352203a74307bd3b6157f78f6b97', 'request_id': 'req-1e53819f-18d1-4cb5-af4b-32b66dff864d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:28.040567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05aa352203a74307bd3b6157f78f6b97', 'request_id': 'req-1e53819f-18d1-4cb5-af4b-32b66dff864d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:28.132974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] The token cache is being invalidate because project 05aa352203a74307bd3b6157f78f6b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:28.133290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:28.134225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1e53819f-18d1-4cb5-af4b-32b66dff864d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:28.140570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1120/2220] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:27 2021] DELETE /identity/v3/projects/05aa352203a74307bd3b6157f78f6b97 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:28.147614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c470-a554-497d-b54c-8070d80522cb None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.148708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c470-a554-497d-b54c-8070d80522cb None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.149237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490c470-a554-497d-b54c-8070d80522cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.182936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0490c470-a554-497d-b54c-8070d80522cb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:28.184437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0490c470-a554-497d-b54c-8070d80522cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:28.245469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1101/2221] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:28.253237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.253516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.254695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.273028 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:28.274329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:28.285519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1121/2222] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:28.289851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490c470-a554-497d-b54c-8070d80522cb None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.300396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490c470-a554-497d-b54c-8070d80522cb None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.305167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.305847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.306130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.306405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.307124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:28.307431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.309706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.322393 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1102/2223] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:43:28.327184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.336955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5cce8-2d01-4329-ba46-3ff5bfba8792 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.343182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.343848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.344173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.344445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.345129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.347027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.488388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1122/2224] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:28 2021] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:28.490009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.502413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3fca9-e01f-44f4-b933-f9dc33e4a9e7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.567030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.568447 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.568903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.569261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.570040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.572281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.713069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1103/2225] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:28 2021] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:28.717676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.729794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e23e-f962-43cd-9824-b8000ca6256b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.737624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.739505 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.740143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.740672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.741662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.744253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.760509 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1123/2226] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:28.764527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.775706 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ad2d2-f861-4c39-959c-aab73e87598e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.787753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.788803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.789288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.789790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.790740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.793541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.805764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1104/2227] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:28.810273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.821130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3f257-db98-41ce-9936-6f294280f468 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.829625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:28.832171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:28.836364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:28.837288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.837570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.837842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] PATH_INFO: `/v3/projects/f2ca1b67b91c43ae9d4985fdf1b29c8b/users/7ed00f06e2bd4e62927990a64257d794/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.857984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ca1b67b91c43ae9d4985fdf1b29c8b, user_id=7ed00f06e2bd4e62927990a64257d794, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:28.861762 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3160d-a35f-4c8f-bc67-0983ec7807cd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:28.930476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edf460-52ac-4fc9-9289-1b6bb0628870 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:28.930629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1124/2228] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:28 2021] PUT /identity/v3/projects/f2ca1b67b91c43ae9d4985fdf1b29c8b/users/7ed00f06e2bd4e62927990a64257d794/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:28.941713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:28.941928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:28.942203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:28.979559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] MFA Rules not processed for user `7ed00f06e2bd4e62927990a64257d794`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:28.980818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:29.016140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '602c9d2fe46b40a999e1ab127c48e7d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b61a89f949c54dfbac4eab051f3ac544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.016859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.017157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.017441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.018177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:29.018493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.020118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.037182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1105/2229] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:43:29.041315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.052236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b210f4-a955-4855-823f-b5e5785d6be1 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.057480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '602c9d2fe46b40a999e1ab127c48e7d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b61a89f949c54dfbac4eab051f3ac544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.058449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.058773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.059095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.059799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.062748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.069909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1125/2230] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:28 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:29.074226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.147508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c270-e279-4a68-b0b5-ba8e8c008496 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.152574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.153740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.154028 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.154308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.155007 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.156955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.174004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1106/2231] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:29 2021] POST /identity/v3/projects => generated 355 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:29.177908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.249850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ef6a-61a4-45f2-987a-5aa0996fa81b tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.255152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '602c9d2fe46b40a999e1ab127c48e7d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b61a89f949c54dfbac4eab051f3ac544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.255867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.256358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.256652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.257426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:29.257750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.259384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.272252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1107/2232] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:29.308644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.319689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464c91b-3eee-404b-86b1-8692d0009163 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.324966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1126/2233] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:29 2021] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:29.325783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.448650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8637e-789a-469a-9ac0-651349682d6f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.453293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '602c9d2fe46b40a999e1ab127c48e7d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b61a89f949c54dfbac4eab051f3ac544', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.454176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.454464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.454735 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] PATH_INFO: `/v3/projects/96e21234dc1d41cbae720690fd7d1c31` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.456486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96e21234dc1d41cbae720690fd7d1c31)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.458417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.470721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.471800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.472139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.472530 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.473392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.475785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.633011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1127/2234] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:29 2021] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:29.636682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.647068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c8d0-6873-45f4-a14d-5642c34cafc6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.652115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.653527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.653527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.659062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.659062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.660237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.673991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1128/2235] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:29.678890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.686126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e21234dc1d41cbae720690fd7d1c31', 'request_id': 'req-1a07122b-9cad-4129-b6d2-542537cbf646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:29.694966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e21234dc1d41cbae720690fd7d1c31', 'request_id': 'req-1a07122b-9cad-4129-b6d2-542537cbf646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:29.696242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a52c9-1686-45b2-9473-71e47d4ca1f0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:29.781224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:29.782473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:29.786527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:29.786527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] PATH_INFO: `/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90/users/bc4e62885b0a484b93fc167d1fa13a12/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:29.801149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=703d44b5ba9a4a3ca305d09ab6973b90, user_id=bc4e62885b0a484b93fc167d1fa13a12, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:29.803913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:29.837605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e21234dc1d41cbae720690fd7d1c31', 'request_id': 'req-1a07122b-9cad-4129-b6d2-542537cbf646'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:29.849557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] The token cache is being invalidate because project 96e21234dc1d41cbae720690fd7d1c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:29.849994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:29.850766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:29.853032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1108/2236] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:29 2021] DELETE /identity/v3/projects/96e21234dc1d41cbae720690fd7d1c31 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:29.932748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1129/2237] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:29 2021] PUT /identity/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90/users/bc4e62885b0a484b93fc167d1fa13a12/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:29.933843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:29.935691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:29.950568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07122b-9cad-4129-b6d2-542537cbf646 tempest-VolumeQuotaClassesTest-1707819947 tempest-VolumeQuotaClassesTest-1707819947-project-admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.021879 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.022350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.022640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.023012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.023800 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.026423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f5261-612f-4395-a6c6-9d3618a1421b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.039056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1109/2238] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:30.042612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.054440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524abd4-0ae5-4441-88e8-07ff48e7a1fa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.061435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.062597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.062937 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.063285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] PATH_INFO: `/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90/users/bc4e62885b0a484b93fc167d1fa13a12/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.065432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703d44b5ba9a4a3ca305d09ab6973b90, user_id=bc4e62885b0a484b93fc167d1fa13a12, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.068444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.080123 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1130/2239] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:30 2021] PUT /identity/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90/users/bc4e62885b0a484b93fc167d1fa13a12/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:30.091453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfef89-4981-46dd-ad75-c5959d0be57f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.091998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfef89-4981-46dd-ad75-c5959d0be57f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.092468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfef89-4981-46dd-ad75-c5959d0be57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.129649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0cdfef89-4981-46dd-ad75-c5959d0be57f None None] MFA Rules not processed for user `bc4e62885b0a484b93fc167d1fa13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:30.132001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0cdfef89-4981-46dd-ad75-c5959d0be57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.220563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1110/2240] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:30 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:30.235344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.238490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.330078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8954aa-316f-4555-9ed8-e9dac1e803d3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.340924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.341611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.341935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.342211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.355977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.358131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.371222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1131/2241] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:30 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:30.510641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.510949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.511225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.563251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] MFA Rules not processed for user `79bc1be4a0e5421aa5e8c2792f7fb05a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:30.567450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.623607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.625225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.677643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1111/2242] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:30 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:30.678828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.680613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.701551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ffa58-153f-4b39-bbe8-478e165be6bf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.708611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.709469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.709893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.710457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.712369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.731269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853736-ef89-4c0f-949d-47eb41bbf2d4 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.737922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.739030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.739440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.739851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] PATH_INFO: `/v3/users/d930e8d6eebb4541810739cc4b99171a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.743193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d930e8d6eebb4541810739cc4b99171a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.745630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.799397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.800908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.814464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1112/2243] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:30 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:30.815117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.816680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:30.837066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1500d88-2595-4e81-8206-b6912233af1b service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:30.845717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:30.846621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:30.846983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:30.847333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:30.848633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:30.850672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:30.978922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1113/2244] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:30 2021] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:30.983113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:30.989308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd930e8d6eebb4541810739cc4b99171a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:31.007646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd930e8d6eebb4541810739cc4b99171a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:31.082567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd930e8d6eebb4541810739cc4b99171a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:31.084402 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd930e8d6eebb4541810739cc4b99171a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:31.085407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f80ab658-68c3-4972-a570-1da6e09ec051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd930e8d6eebb4541810739cc4b99171a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:31.105052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00412296-3c7c-4672-99a1-00f6d3ae91b2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.120282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.121279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.121783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.122221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.123081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.125209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.127511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1132/2245] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:30 2021] DELETE /identity/v3/users/d930e8d6eebb4541810739cc4b99171a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:31.141265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.142042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.142394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.161531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:31.162864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:31.256914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1114/2246] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:30 2021] POST /identity/v3/users => generated 299 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:31.260929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:31.261178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1133/2247] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:31.263741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:31.276861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:31.285501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:31.294901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd31ee-0453-4c0a-a2ed-d285164f9d1d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.309861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.311703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.311991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.312288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.313031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.316225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.360917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1115/2248] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:31.361866 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:31.385006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b32c-a45c-4ee9-8f8f-77b4e031e612 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.391801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.393074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.393532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.393815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] PATH_INFO: `/v3/projects/e29df45c216a4d2bac97bd58e263964e/users/3b4840a6ddef4ad6b96a38f80c0b1dab/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.411049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29df45c216a4d2bac97bd58e263964e, user_id=3b4840a6ddef4ad6b96a38f80c0b1dab, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.414676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.422665 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46da2c-1ef9-464a-a30b-32b7bdd11447 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.426620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.427279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.427561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.427848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.437721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.439181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.451116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1134/2249] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:31.527441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1116/2250] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:31 2021] PUT /identity/v3/projects/e29df45c216a4d2bac97bd58e263964e/users/3b4840a6ddef4ad6b96a38f80c0b1dab/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:31.532674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:31.549643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db1595-205b-4c36-83b9-1330f1b28545 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.628045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.628772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.629058 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.631363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.631363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.631982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.644245 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1135/2251] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:31.647007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:31.659577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad466054-fbb9-478a-853c-ebefe3670036 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:31.664943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:31.666099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:31.666392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:31.666670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] PATH_INFO: `/v3/projects/e29df45c216a4d2bac97bd58e263964e/users/3b4840a6ddef4ad6b96a38f80c0b1dab/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:31.668841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29df45c216a4d2bac97bd58e263964e, user_id=3b4840a6ddef4ad6b96a38f80c0b1dab, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:31.671508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:31.683033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1117/2252] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:31 2021] PUT /identity/v3/projects/e29df45c216a4d2bac97bd58e263964e/users/3b4840a6ddef4ad6b96a38f80c0b1dab/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:32.141969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:32.143831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:32.157492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0ab8c-1b18-4e6a-bd39-6023c32fae79 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:32.242194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:32.243272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:32.243686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:32.243974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] PATH_INFO: `/v3/projects/8c210bcd02904f7aa924aae8ef2d8f32` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:32.245557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c210bcd02904f7aa924aae8ef2d8f32)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:32.248554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:32.419662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c210bcd02904f7aa924aae8ef2d8f32', 'request_id': 'req-82b1b028-d746-4d02-ad18-f0a6e288deaf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:32.426958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c210bcd02904f7aa924aae8ef2d8f32', 'request_id': 'req-82b1b028-d746-4d02-ad18-f0a6e288deaf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:32.440164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c210bcd02904f7aa924aae8ef2d8f32', 'request_id': 'req-82b1b028-d746-4d02-ad18-f0a6e288deaf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:32.599203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] The token cache is being invalidate because project 8c210bcd02904f7aa924aae8ef2d8f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:32.600613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:32.602107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:32.604984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1136/2253] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:32 2021] DELETE /identity/v3/projects/8c210bcd02904f7aa924aae8ef2d8f32 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:32.609851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:32.612226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:32.625486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6a84-ac66-47d9-adad-fc0f9c3a4ba6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:32.699348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:32.700820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:32.701147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:32.701421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] PATH_INFO: `/v3/users/602c9d2fe46b40a999e1ab127c48e7d0` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:32.703011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602c9d2fe46b40a999e1ab127c48e7d0)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:32.705153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:33.016914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602c9d2fe46b40a999e1ab127c48e7d0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:33.017546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602c9d2fe46b40a999e1ab127c48e7d0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:33.018177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602c9d2fe46b40a999e1ab127c48e7d0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:33.026604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602c9d2fe46b40a999e1ab127c48e7d0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:33.041545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ec8af07a-eaa8-4388-b067-3fc1e5b2eef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602c9d2fe46b40a999e1ab127c48e7d0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:33.145739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1118/2254] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:32 2021] DELETE /identity/v3/users/602c9d2fe46b40a999e1ab127c48e7d0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:33.893522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:33.905787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b028-d746-4d02-ad18-f0a6e288deaf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:33.984758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:33.984758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:33.984758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:33.984758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] PATH_INFO: `/v3/projects/b61a89f949c54dfbac4eab051f3ac544` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:33.985273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61a89f949c54dfbac4eab051f3ac544)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:33.987132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:34.149884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61a89f949c54dfbac4eab051f3ac544', 'request_id': 'req-06ac9d28-4476-403d-bd34-dd1a413f305d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:34.158310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61a89f949c54dfbac4eab051f3ac544', 'request_id': 'req-06ac9d28-4476-403d-bd34-dd1a413f305d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:34.175715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61a89f949c54dfbac4eab051f3ac544', 'request_id': 'req-06ac9d28-4476-403d-bd34-dd1a413f305d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:34.291623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] The token cache is being invalidate because project b61a89f949c54dfbac4eab051f3ac544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:34.291623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:34.291623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-06ac9d28-4476-403d-bd34-dd1a413f305d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:34.293052 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1137/2255] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:33 2021] DELETE /identity/v3/projects/b61a89f949c54dfbac4eab051f3ac544 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:34.299276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.300622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.301075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.332009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:34.333541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:34.413254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1119/2256] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:34.424703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.424703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.424703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.458237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:34.459749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:34.475969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1138/2257] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:34.477133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:34.487112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d28eea-a752-4e68-9d4a-edc6a77caf36 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:34.492065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:34.492788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.493259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.493534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.494267 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:34.494576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:34.496157 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:34.515493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1120/2258] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:34.522991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:34.534629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa912f1-0cc2-462c-b8df-40152d8ea51e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:34.540026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:34.540822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.541187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.541541 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.542326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:34.545097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:34.687880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1139/2259] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:34 2021] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:34.691961 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:34.705811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e3cb1-9679-46a0-a6f4-929ea36144e5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:34.800669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:34.800669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.800669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.800669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.801093 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:34.801785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:34.923171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1121/2260] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:34 2021] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:34.924558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:34.942255 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c364-4666-4cec-9072-5517e3caf093 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:34.951488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:34.956457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:34.957279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:34.957699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:34.959772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:34.962086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:34.988238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1140/2261] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:34 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:34.991869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.005543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052498bd-bc89-42d6-aa7b-509097daf772 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.010857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.011690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.011981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.012332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.013073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.014709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1472e-9273-4fac-b93c-499478c45ed5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.028414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1122/2262] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:34 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:35.030927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.042193 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03110278-ab6d-4f0c-94ea-e19933912f2b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.048654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.049688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.049688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.049965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] PATH_INFO: `/v3/projects/aa978e24e22942a786899d6c7245e093/users/218c0e3294854d1fa8607d59e39436aa/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.072383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa978e24e22942a786899d6c7245e093, user_id=218c0e3294854d1fa8607d59e39436aa, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.076017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.199481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1141/2263] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:35 2021] PUT /identity/v3/projects/aa978e24e22942a786899d6c7245e093/users/218c0e3294854d1fa8607d59e39436aa/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:35.210594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.210897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.211180 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.250045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] MFA Rules not processed for user `218c0e3294854d1fa8607d59e39436aa`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:35.251356 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:35.326770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1123/2264] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:35 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:35.331362 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.396126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae919-4af4-4102-873e-bf42e5b63685 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.401101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.401788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.402027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.402300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.403516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.405455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.573246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1142/2265] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:35 2021] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:35.578212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.593750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca102bc-17ff-4b1f-9514-ec64e306a938 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.658024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.658952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.659244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.659538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.664304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.664304 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.756004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1124/2266] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:35 2021] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:35.760166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.772099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6e1c-9a43-417a-9664-b349ceb75341 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.778773 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.779606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.779897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.780174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.786510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.786510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.796682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1143/2267] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:35 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:35.801055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.812753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e8180-1d2a-4c27-9d88-54e5e8d0f502 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:35.818442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:35.819437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:35.819726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:35.820010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] PATH_INFO: `/v3/projects/c9e4c4a914a44070b26740160634d942/users/c41ae5bec25e416f87a660f47068e40f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:35.837613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e4c4a914a44070b26740160634d942, user_id=c41ae5bec25e416f87a660f47068e40f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:35.841142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:35.932790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1125/2268] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:35 2021] PUT /identity/v3/projects/c9e4c4a914a44070b26740160634d942/users/c41ae5bec25e416f87a660f47068e40f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:35.937995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:35.955435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e8276-7eac-4aad-b284-5ca3b80e3598 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:36.043703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:36.044673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:36.044959 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:36.045300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:36.046112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:36.048262 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28581e-6873-4a5f-9821-53cc44bf0353 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:36.061425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1144/2269] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:35 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:36.065573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:36.077388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04add0bf-dfc6-47ab-9719-8ee9877bbfed admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:36.084414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:36.086358 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:36.086894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:36.089657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] PATH_INFO: `/v3/projects/c9e4c4a914a44070b26740160634d942/users/c41ae5bec25e416f87a660f47068e40f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:36.094561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e4c4a914a44070b26740160634d942, user_id=c41ae5bec25e416f87a660f47068e40f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:36.097654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:36.110910 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1126/2270] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:36 2021] PUT /identity/v3/projects/c9e4c4a914a44070b26740160634d942/users/c41ae5bec25e416f87a660f47068e40f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:36.123482 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:36.127202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:36.127202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:36.178749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] MFA Rules not processed for user `c41ae5bec25e416f87a660f47068e40f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:36.180018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:36.258502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1145/2271] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:36 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:36.269004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:36.270708 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:36.337863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b7b1-8f67-4977-886e-4566f4fc088d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:36.343825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:36.344836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:36.345227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:36.345607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:36.365876 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:36.367506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f7fd6-8db8-4585-903a-c2a3abfe87f8 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:36.389683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1127/2272] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:36 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:36.497087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:36.506326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a236d-f389-4a3e-aab9-5af25db6d52d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:36.509906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:36.510560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:36.510847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:36.511125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:36.570304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:36.573002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:36.583932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1146/2273] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:36 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:38.405106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56beb-86dd-4201-81cb-b9e10e2e2403 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:38.407489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56beb-86dd-4201-81cb-b9e10e2e2403 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:38.407937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e56beb-86dd-4201-81cb-b9e10e2e2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:38.447563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c2e56beb-86dd-4201-81cb-b9e10e2e2403 None None] MFA Rules not processed for user `3b4840a6ddef4ad6b96a38f80c0b1dab`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:38.449132 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2e56beb-86dd-4201-81cb-b9e10e2e2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:38.539460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1128/2274] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:38 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:38.552391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:38.553871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:38.615247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4ade-4a32-4c8c-b62e-503f8478efe2 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:38.619667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:38.620396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:38.620679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:38.621138 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:38.629071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:38.694943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:38.695497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:38.705772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1147/2275] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:38 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:39.040663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:39.040987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:39.041329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:39.060822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:39.062604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:39.120469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1129/2276] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:43:39 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:39.144290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:39.145748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:39.218536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcccea5-e008-46b9-bd96-d929a718c9ad service glance] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:39.223925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:39.224380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:39.224669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:39.224950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:39.234101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:39.235705 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b963c3-f33f-4140-ab24-2f7d58692a06 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:39.244084 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1148/2277] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:43:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:43:41.710043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:41.802076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244dcb40-8267-4775-aeb3-a04216c6f0c6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:41.808154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:41.808863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:41.811101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:41.811628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] PATH_INFO: `/v3/users/218c0e3294854d1fa8607d59e39436aa` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:41.813250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218c0e3294854d1fa8607d59e39436aa)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:41.815278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:42.634730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218c0e3294854d1fa8607d59e39436aa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:42.635487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218c0e3294854d1fa8607d59e39436aa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:42.636111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218c0e3294854d1fa8607d59e39436aa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:42.643398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218c0e3294854d1fa8607d59e39436aa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:42.656024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218c0e3294854d1fa8607d59e39436aa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:42.799750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1130/2278] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:41 2021] DELETE /identity/v3/users/218c0e3294854d1fa8607d59e39436aa => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:42.804026 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:42.804519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:42.804612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:42.835983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:42.841657 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:42.909418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1149/2279] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:42.931820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:42.933611 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:43.019905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd49e7-2d11-43ea-80ec-2335c0e61315 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:43.025853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:43.026586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:43.026877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:43.027219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:43.040687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:43.042522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:43.056558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1131/2280] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:43.802768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:43.808075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:43.859450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a37a-fa29-46f1-bad1-3d1485fc2cd0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:43.890279 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:43.892253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:43.893118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:43.893938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] PATH_INFO: `/v3/projects/aa978e24e22942a786899d6c7245e093` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:43.901001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa978e24e22942a786899d6c7245e093)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:43.907906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:44.089624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa978e24e22942a786899d6c7245e093', 'request_id': 'req-a1de28b9-0b22-4551-800f-c83190b33a5c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.097974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa978e24e22942a786899d6c7245e093', 'request_id': 'req-a1de28b9-0b22-4551-800f-c83190b33a5c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.106868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa978e24e22942a786899d6c7245e093', 'request_id': 'req-a1de28b9-0b22-4551-800f-c83190b33a5c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.215041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] The token cache is being invalidate because project aa978e24e22942a786899d6c7245e093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:44.222059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.222059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.222059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1150/2281] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:43 2021] DELETE /identity/v3/projects/aa978e24e22942a786899d6c7245e093 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:44.222573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:44.234299 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f113b1-50e0-4c41-b8d3-3a61ec189b00 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:44.378455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:44.379360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:44.379649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:44.379926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] PATH_INFO: `/v3/users/c41ae5bec25e416f87a660f47068e40f` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:44.381771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41ae5bec25e416f87a660f47068e40f)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:44.383606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:44.775178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41ae5bec25e416f87a660f47068e40f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.775854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41ae5bec25e416f87a660f47068e40f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.776618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41ae5bec25e416f87a660f47068e40f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.785174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41ae5bec25e416f87a660f47068e40f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.803952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ffe69822-d9b8-4a8a-b46e-262e428387bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41ae5bec25e416f87a660f47068e40f'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:44.930227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1132/2282] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:44 2021] DELETE /identity/v3/users/c41ae5bec25e416f87a660f47068e40f => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:45.546829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:45.546829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:45.564737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de28b9-0b22-4551-800f-c83190b33a5c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:45.639599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:45.640538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:45.640831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:45.641142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] PATH_INFO: `/v3/projects/c9e4c4a914a44070b26740160634d942` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:45.642436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e4c4a914a44070b26740160634d942)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:45.644452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.117097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e4c4a914a44070b26740160634d942', 'request_id': 'req-2c3c1307-17d6-4519-a3cb-1330976b2a1e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:46.122907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e4c4a914a44070b26740160634d942', 'request_id': 'req-2c3c1307-17d6-4519-a3cb-1330976b2a1e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:46.129282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e4c4a914a44070b26740160634d942', 'request_id': 'req-2c3c1307-17d6-4519-a3cb-1330976b2a1e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:46.282994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] The token cache is being invalidate because project c9e4c4a914a44070b26740160634d942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:46.283260 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:46.283897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2c3c1307-17d6-4519-a3cb-1330976b2a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:46.286385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1151/2283] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:45 2021] DELETE /identity/v3/projects/c9e4c4a914a44070b26740160634d942 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:46.291870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.292803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.293797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.315406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:46.316860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:46.388348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1133/2284] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:46.396525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.396952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.397337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.419010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:46.420391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:46.428735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1152/2285] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:46.433414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.446559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da85f2-a8a1-423e-a4d7-c614c10867c2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.451922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.452709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.453095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.453457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.454251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:46.454627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.456311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.471592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1134/2286] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:46.475854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.489488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f5a2-1947-4787-be8a-7350b194bc92 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.495030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.495688 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.495967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.496827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.497534 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.499451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.600411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1153/2287] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:46 2021] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:46.604280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.617506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1856207-42db-4f95-ab94-b50eabbe275e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.685176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.685849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.686202 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.686486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.687210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.689228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.838485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1135/2288] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:46 2021] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:46.842731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.861662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beacdd-f7e8-46a4-a2ae-af50f558e9fe admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.861662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.862043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.862345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.862827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.864002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.865538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.879473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1154/2289] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:46 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:46.880861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.891144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d64c63-83c1-44c7-90da-a75d033b2f67 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.895990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.896716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.896997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.897324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.898059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.899648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a775cab-a76c-40b8-af2b-471a10721f48 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:46.914193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1136/2290] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:46.915392 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:46.928942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aae31-ce18-448f-bad9-76841ddde8c3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:46.934821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:46.935807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:46.936235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:46.936606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] PATH_INFO: `/v3/projects/d39f4ace519a4d4ea2d1fac67c281bfe/users/20ff2f000fbd41a39f66f10695e0a6d6/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:46.953053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39f4ace519a4d4ea2d1fac67c281bfe, user_id=20ff2f000fbd41a39f66f10695e0a6d6, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:46.955922 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.050036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1155/2291] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:46 2021] PUT /identity/v3/projects/d39f4ace519a4d4ea2d1fac67c281bfe/users/20ff2f000fbd41a39f66f10695e0a6d6/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:47.060676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.060990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.061245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.099609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] MFA Rules not processed for user `20ff2f000fbd41a39f66f10695e0a6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:47.101231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:47.176029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1137/2292] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:47.180382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.257129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7f32-8a4d-4d46-a175-d9028ec102cb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.262643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.263343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.263627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.263905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.264729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.266643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.363823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1156/2293] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:47 2021] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:47.367639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.383087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21650d14-e974-48bb-a33a-8964fa9de1ac None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.460609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.461228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.461614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.461778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.462535 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.464485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.580797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1138/2294] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:47 2021] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:47.581671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.595691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e038a-4495-4331-930a-2a3052bffc56 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.600929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.602404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.602695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.602979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.603796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.606116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.621949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1157/2295] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:47.625360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.636426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc068f-833f-4318-93bc-33c7280171ca admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.642210 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.643476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.643945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.644276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] PATH_INFO: `/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28/users/d0f44eaa6f5849a0a5f9072ab6d399f4/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.662690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1fd162e8bc4dcaa495bf3140a6ea28, user_id=d0f44eaa6f5849a0a5f9072ab6d399f4, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.668918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.838639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1139/2296] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:47 2021] PUT /identity/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28/users/d0f44eaa6f5849a0a5f9072ab6d399f4/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:47.843190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.856246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ddbdf-bfb9-4d97-8633-e05960571f61 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.919401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.920234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.920517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.920800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.921536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.923223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6b639-4f9d-4732-bf5c-2a79af819468 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.936447 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1158/2297] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:47 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:47.939351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:47.951856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a31bb-f97d-4722-bc7b-7eb19d980aed admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:47.956790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:47.957670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.957956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.958241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] PATH_INFO: `/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28/users/d0f44eaa6f5849a0a5f9072ab6d399f4/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:47.960414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1fd162e8bc4dcaa495bf3140a6ea28, user_id=d0f44eaa6f5849a0a5f9072ab6d399f4, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:47.963044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:47.975439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1140/2298] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:47 2021] PUT /identity/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28/users/d0f44eaa6f5849a0a5f9072ab6d399f4/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:47.988156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:47.988791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:47.989602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:48.020977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] MFA Rules not processed for user `d0f44eaa6f5849a0a5f9072ab6d399f4`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:48.022643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:48.104996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1159/2299] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:47 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:48.118427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:48.120222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:48.185056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c06e-77bb-4592-b44a-0291b5983701 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:48.189190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:48.190023 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:48.190310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:48.190591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:48.201995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:48.203518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077a82-0dcf-41b9-b0c9-d119ea632a9e service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:48.216859 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1141/2300] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:48 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:43:48.921722 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:48.963577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1272-5112-413f-be7e-d7076fbf34dd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:48.968181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:48.969078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:48.969364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:48.969643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] PATH_INFO: `/v3/users/20ff2f000fbd41a39f66f10695e0a6d6` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:48.970824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ff2f000fbd41a39f66f10695e0a6d6)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:48.972811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:49.308183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ff2f000fbd41a39f66f10695e0a6d6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:49.320349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ff2f000fbd41a39f66f10695e0a6d6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:49.471044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ff2f000fbd41a39f66f10695e0a6d6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:49.471663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ff2f000fbd41a39f66f10695e0a6d6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:49.472302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ff2f000fbd41a39f66f10695e0a6d6'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:49.489594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1160/2301] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:48 2021] DELETE /identity/v3/users/20ff2f000fbd41a39f66f10695e0a6d6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:49.494240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:49.494739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:49.494846 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:49.513780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:49.515002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:49.581390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1142/2302] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:49.592039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:49.593529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:49.649302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb91f95-092e-439f-bdde-4da9390fe2a2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:49.653398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:49.654040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:49.654342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:49.654614 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:49.663527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:49.664986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:49.674797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1161/2303] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:50.160137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:50.161604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:50.177371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f69d77-a186-475d-82b8-10356dd2ee68 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:50.182284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:50.183229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:50.183519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:50.184402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] PATH_INFO: `/v3/projects/d39f4ace519a4d4ea2d1fac67c281bfe` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:50.185609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39f4ace519a4d4ea2d1fac67c281bfe)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:50.187564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:50.442260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39f4ace519a4d4ea2d1fac67c281bfe', 'request_id': 'req-2ae21a55-a03f-4206-b549-5186bb33c3fd'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.448339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39f4ace519a4d4ea2d1fac67c281bfe', 'request_id': 'req-2ae21a55-a03f-4206-b549-5186bb33c3fd'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.557556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39f4ace519a4d4ea2d1fac67c281bfe', 'request_id': 'req-2ae21a55-a03f-4206-b549-5186bb33c3fd'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.568426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] The token cache is being invalidate because project d39f4ace519a4d4ea2d1fac67c281bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:50.568872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.569635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-2ae21a55-a03f-4206-b549-5186bb33c3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.571503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1143/2304] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:50 2021] DELETE /identity/v3/projects/d39f4ace519a4d4ea2d1fac67c281bfe => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:50.575621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:50.585032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d4274-17a5-4d5f-9cf7-322100e60ee9 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:50.645201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:50.645201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:50.645201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:50.645201 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] PATH_INFO: `/v3/users/d0f44eaa6f5849a0a5f9072ab6d399f4` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:50.645659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f44eaa6f5849a0a5f9072ab6d399f4)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:50.645659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:50.933587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f44eaa6f5849a0a5f9072ab6d399f4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:50.948293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f44eaa6f5849a0a5f9072ab6d399f4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.065496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f44eaa6f5849a0a5f9072ab6d399f4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.066129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f44eaa6f5849a0a5f9072ab6d399f4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.066724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f44eaa6f5849a0a5f9072ab6d399f4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.079932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1162/2305] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:43:50 2021] DELETE /identity/v3/users/d0f44eaa6f5849a0a5f9072ab6d399f4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:51.381107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f4c9-4081-43bf-9585-962ab229f216 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:51.383966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f4c9-4081-43bf-9585-962ab229f216 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:51.383966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96f4c9-4081-43bf-9585-962ab229f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:51.399488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-9a96f4c9-4081-43bf-9585-962ab229f216 None None] MFA Rules not processed for user `79bc1be4a0e5421aa5e8c2792f7fb05a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:51.400727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9a96f4c9-4081-43bf-9585-962ab229f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:51.456178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1144/2306] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:51 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:51.573658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:51.575157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:51.661465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688adc-baba-4de2-bc00-37dc0a4bf962 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:51.666465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:51.667360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:51.667648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:51.668462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] PATH_INFO: `/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:51.669675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1fd162e8bc4dcaa495bf3140a6ea28)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:51.671664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:51.837081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1fd162e8bc4dcaa495bf3140a6ea28', 'request_id': 'req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.843032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1fd162e8bc4dcaa495bf3140a6ea28', 'request_id': 'req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:51.849315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1fd162e8bc4dcaa495bf3140a6ea28', 'request_id': 'req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:52.008082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] The token cache is being invalidate because project 4f1fd162e8bc4dcaa495bf3140a6ea28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:43:52.008403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:52.009016 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-2bd760a3-f8c0-4ef7-9722-fb2c6401783f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:43:52.010525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1163/2307] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:43:51 2021] DELETE /identity/v3/projects/4f1fd162e8bc4dcaa495bf3140a6ea28 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:52.016333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.016811 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.016911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.034631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:52.035836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:52.092612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1145/2308] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:52.100439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.100737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.101020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.120864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:52.122381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:52.130373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1164/2309] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:52.134885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.145035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b014ef1-b06a-4de7-9284-7a3334c5bebf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.149769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.150420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.150703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.150978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.151697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:43:52.152047 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.158192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.170060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1146/2310] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:43:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:43:52.171172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.187764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ace0d-e147-47ec-9593-dcee89f2d666 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.187764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.187764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.187764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.188161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.188161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.189949 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.303456 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1165/2311] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:52 2021] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:43:52.315484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.325769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136488fd-08d4-4b5a-b851-fa902327b567 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.381532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.382217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.382506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.382785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.383639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.385575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.500485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1147/2312] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:52 2021] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:52.504876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.515624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51ebdb-8d69-4436-9d53-be0bcb091ede admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.520169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.520886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.521172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.521483 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.522196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.523774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.534063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1166/2313] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:52.537931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.547534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313dd58-3d29-4233-bd05-113e03b5ff40 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.552095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.552805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.553091 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.553371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.554084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.555717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588a43-9f07-4773-9c0e-983cc68b4af8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.566027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1148/2314] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:52.570160 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.580720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e221db-9cae-44a6-9947-e081fe531be2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.585486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.586348 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.586630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.586909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] PATH_INFO: `/v3/projects/5ba4a721579e4deaa3a42a3964fc63c9/users/45fc76a4914640efa93ee5d197397d4d/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.602057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba4a721579e4deaa3a42a3964fc63c9, user_id=45fc76a4914640efa93ee5d197397d4d, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.604717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.762831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1167/2315] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:52 2021] PUT /identity/v3/projects/5ba4a721579e4deaa3a42a3964fc63c9/users/45fc76a4914640efa93ee5d197397d4d/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:43:52.768349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eceaa-190e-4701-ad64-7aa5aba23150 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.768645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eceaa-190e-4701-ad64-7aa5aba23150 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.768929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eceaa-190e-4701-ad64-7aa5aba23150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.786213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-488eceaa-190e-4701-ad64-7aa5aba23150 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:52.787426 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-488eceaa-190e-4701-ad64-7aa5aba23150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:52.843317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1149/2316] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:52.853225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:52.854901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:52.910839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1c545-3c80-4fb4-bf79-34c4489fe115 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:52.914627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:52.915280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:52.915565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:52.915846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:52.924838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:52.926267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:52.935478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1168/2317] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:43:54.498500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:54.499032 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:54.506010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:54.525590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] MFA Rules not processed for user `45fc76a4914640efa93ee5d197397d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:54.526934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:54.594158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1150/2318] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:54 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:54.598462 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:54.610626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dfcfe-595f-44f4-8059-d43ff38684d0 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:54.615735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:54.616438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:54.616812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:54.617288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:54.618222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:54.620430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:54.771727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1169/2319] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:43:54 2021] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:54.775058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:54.785389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e48d0-486e-4655-83ef-64e3ab35a0df None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:54.839673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:54.840401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:54.840688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:54.840969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:54.841655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:54.843555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:55.050984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1151/2320] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:43:54 2021] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:43:55.073015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:55.083895 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d808f-6aaa-46da-bb2e-4e50e4d478d0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:55.088681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:55.089343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:55.089627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:55.089903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:55.090625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:55.092236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:55.103525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1170/2321] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:43:55.124576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:55.134383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b4acf-17f3-45a8-b30e-dd814b4d701f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:55.139831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:55.140758 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:55.141046 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:55.141327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] PATH_INFO: `/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1/users/e232f13cea5a4d2caa9eec8cbbd4d820/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:55.156254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd072f59e1a4a5b9879ac20dfb372e1, user_id=e232f13cea5a4d2caa9eec8cbbd4d820, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:55.158881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:55.317065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1152/2322] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:55 2021] PUT /identity/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1/users/e232f13cea5a4d2caa9eec8cbbd4d820/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:55.323238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:55.332067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b35806-2373-4339-b691-636aeceeee68 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:55.388737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:55.389413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:55.389698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:55.389974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:55.390697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:55.392457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e612-a87c-4d29-b728-ac1f15d65b57 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:55.404183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1171/2323] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:43:55 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:43:55.412789 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:55.423049 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d396-61a8-40d6-ae8f-f6544ef66e3f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:55.427664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:55.428563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:55.428847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:55.429120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] PATH_INFO: `/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1/users/e232f13cea5a4d2caa9eec8cbbd4d820/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:55.431106 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd072f59e1a4a5b9879ac20dfb372e1, user_id=e232f13cea5a4d2caa9eec8cbbd4d820, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:55.433798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532a5f8-70dc-49a8-a5da-e585d249d6b7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:55.443869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1153/2324] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:43:55 2021] PUT /identity/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1/users/e232f13cea5a4d2caa9eec8cbbd4d820/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:43:57.258569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:57.259833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:57.260357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:57.279555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:57.280870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:57.305216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:57.305729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:57.305899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:57.337900 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] MFA Rules not processed for user `e232f13cea5a4d2caa9eec8cbbd4d820`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:43:57.339079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:57.359558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1172/2325] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:43:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:43:57.373211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:57.374861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:57.421430 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1154/2326] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:43:57 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:43:57.431884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:57.433761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:57.478251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7626f-3b6d-4d69-b921-76bda8ea3719 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:57.486575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:57.487473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:57.493533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:57.494132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:57.498261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534a54-83fa-494a-83bf-73cc3d6867c5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:57.502707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:57.508089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:57.508089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:57.508089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:57.508546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:57.508546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:57.517788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1173/2327] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:43:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 03:43:57.573199 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:57.575288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:57.584968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1155/2328] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:57 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:43:59.866873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:43:59.868327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:43:59.881409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e123f-7f73-4f11-b37c-507f76bbab1d service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:43:59.885073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:43:59.885707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:43:59.885987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:43:59.886258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:43:59.895203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:43:59.896726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:43:59.905891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1174/2329] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:43:59 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:16.770076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:16.822004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e7e8-c260-460a-822b-86666b43c2a8 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:16.826240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:16.826881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:16.834820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:16.834820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:16.834820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:16.902774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:16.904223 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:16.914890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1156/2330] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:17.038636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:17.038636 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:17.066812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089537c-f992-4a36-8ec4-6aac5f993db0 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:17.080777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:17.080777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:17.080777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:17.080777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:17.081836 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:17.099488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:17.101342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:17.114916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1175/2331] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:24.137504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:24.259673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeed72-2aae-4dca-80b1-3ff35a657b74 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:24.265435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:24.266541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:24.266826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:24.267104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] PATH_INFO: `/v3/users/45fc76a4914640efa93ee5d197397d4d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:24.268388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fc76a4914640efa93ee5d197397d4d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:24.270315 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:24.485935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fc76a4914640efa93ee5d197397d4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:24.486696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fc76a4914640efa93ee5d197397d4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:24.487376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fc76a4914640efa93ee5d197397d4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:24.500276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fc76a4914640efa93ee5d197397d4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:24.529969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fc76a4914640efa93ee5d197397d4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:24.588817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1157/2332] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:24 2021] DELETE /identity/v3/users/45fc76a4914640efa93ee5d197397d4d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:25.033512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:25.046176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bb4a5-2a19-4cc8-9747-f081a6d92d1f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:25.146066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:25.146422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:25.146698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:25.147187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] PATH_INFO: `/v3/projects/5ba4a721579e4deaa3a42a3964fc63c9` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:25.148616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba4a721579e4deaa3a42a3964fc63c9)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:25.150480 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:25.350406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba4a721579e4deaa3a42a3964fc63c9', 'request_id': 'req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:25.359197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba4a721579e4deaa3a42a3964fc63c9', 'request_id': 'req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:25.375192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba4a721579e4deaa3a42a3964fc63c9', 'request_id': 'req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:25.455558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] The token cache is being invalidate because project 5ba4a721579e4deaa3a42a3964fc63c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:25.455994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:25.456832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:25.458851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1176/2333] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:25 2021] DELETE /identity/v3/projects/5ba4a721579e4deaa3a42a3964fc63c9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:25.462950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:25.465146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:25.487408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029de90-166a-46c5-8e3d-4609421ada79 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:25.605454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:25.608311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:25.608311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:25.608311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] PATH_INFO: `/v3/users/e232f13cea5a4d2caa9eec8cbbd4d820` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:25.608862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e232f13cea5a4d2caa9eec8cbbd4d820)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:25.610841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:26.028084 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e232f13cea5a4d2caa9eec8cbbd4d820'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.029082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e232f13cea5a4d2caa9eec8cbbd4d820'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.030016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e232f13cea5a4d2caa9eec8cbbd4d820'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.038833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e232f13cea5a4d2caa9eec8cbbd4d820'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.052993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e8226434-4549-47f6-815a-4cdb1e2a78ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e232f13cea5a4d2caa9eec8cbbd4d820'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.116307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1158/2334] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:25 2021] DELETE /identity/v3/users/e232f13cea5a4d2caa9eec8cbbd4d820 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:26.405981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:26.407785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:26.429738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5afb-bc42-43df-af8d-bbc3528e12e7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:26.490475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:26.491339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:26.491618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:26.491891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] PATH_INFO: `/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:26.493197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd072f59e1a4a5b9879ac20dfb372e1)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:26.495112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:26.609281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd072f59e1a4a5b9879ac20dfb372e1', 'request_id': 'req-624ff56c-b49c-4285-a0cf-71efe7aad2fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.615536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd072f59e1a4a5b9879ac20dfb372e1', 'request_id': 'req-624ff56c-b49c-4285-a0cf-71efe7aad2fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.621755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd072f59e1a4a5b9879ac20dfb372e1', 'request_id': 'req-624ff56c-b49c-4285-a0cf-71efe7aad2fb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.755687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] The token cache is being invalidate because project 7cd072f59e1a4a5b9879ac20dfb372e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:26.755975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.756646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-624ff56c-b49c-4285-a0cf-71efe7aad2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:26.758189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1177/2335] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:26 2021] DELETE /identity/v3/projects/7cd072f59e1a4a5b9879ac20dfb372e1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:26.769676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:26.770240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:26.770240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:26.788166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:26.789404 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:26.849143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1159/2336] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:26.857174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be068-5477-47cf-9676-481a94278b9e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:26.857469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be068-5477-47cf-9676-481a94278b9e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:26.858186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be068-5477-47cf-9676-481a94278b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:26.876550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d51be068-5477-47cf-9676-481a94278b9e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:26.877775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d51be068-5477-47cf-9676-481a94278b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:26.890732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1178/2337] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:26.892175 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:26.903349 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012a2d-a5d2-4168-bd58-b621a7266a11 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:26.908580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:26.914889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:26.924600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1160/2338] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:44:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:44:26.929145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be068-5477-47cf-9676-481a94278b9e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:26.938468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be068-5477-47cf-9676-481a94278b9e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:26.943205 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:26.943868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:26.944159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:26.944474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:26.945173 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:26.947088 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.032945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1179/2339] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:26 2021] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:27.037248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.047536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71c44-802c-4a3d-84c0-c90bfaa9a977 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.105609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.111273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.111273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.111273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.111273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.111273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.190348 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1161/2340] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:27 2021] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:27.191679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.202641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37090b9-9a32-4132-b8ca-351494ab12ae admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.207591 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.208265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.208554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.208825 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.209679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.211305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.222496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1180/2341] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:27.227278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.237960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3264f0-cdff-4483-967e-c6094f18b67a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.242577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.243234 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.243516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.243787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.244544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.246142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa79314-b3d5-4131-954d-eb4f8c585aa4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.256575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1162/2342] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:27.260375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.270438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ac1cf-f9e9-4304-8677-940599c4a434 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.275076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.275960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.276268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.277105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] PATH_INFO: `/v3/projects/b16a58a3c8c34dc7a18282fa0766356c/users/7de9993723474a0e94c5a0a826bc6396/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.294564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16a58a3c8c34dc7a18282fa0766356c, user_id=7de9993723474a0e94c5a0a826bc6396, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.297510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.368519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1181/2343] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:27 2021] PUT /identity/v3/projects/b16a58a3c8c34dc7a18282fa0766356c/users/7de9993723474a0e94c5a0a826bc6396/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:27.380737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.381038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.381378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.413436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] MFA Rules not processed for user `7de9993723474a0e94c5a0a826bc6396`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:27.414847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:27.483261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1163/2344] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:27 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:27.487831 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.552533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d35c-8bba-4857-a4ac-6cd9801ec3ba admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.557700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.558460 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.558745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.559037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.559741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.561741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:27.675328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1182/2345] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:27 2021] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:44:27.676519 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:27.688281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd98b0-ed90-4dc1-9848-66b4d7b73994 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:27.775968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:27.776818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:27.777043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:27.777766 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:27.778515 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:27.780807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.060996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1164/2346] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:27 2021] POST /identity/v3/users => generated 299 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:28.065259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.068028 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.070339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:28.083194 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a191b90-2de5-4d29-a1fa-7d2152f29bad admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.096756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.098045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.098524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.099176 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.100484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.115624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.122061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1183/2347] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:28 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:28.126493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.141006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ecece-21e8-4344-b02b-7339cb02c4f3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.164129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5a7c0-d626-4217-a2ed-3c3475e380b7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.168035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.168035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.168035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.168607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] PATH_INFO: `/v3/projects/d5c269cec95d4877a39e4b97b634b904/users/2550e08247054070906ca10b2d22bd6a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.170276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.171104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.171564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.172010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.174414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:28.192358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c269cec95d4877a39e4b97b634b904, user_id=2550e08247054070906ca10b2d22bd6a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.202737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.257844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.259177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.269551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1165/2348] 10.222.0.21 () {60 vars in 1397 bytes} [Tue Aug 10 03:44:28 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3405 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:28.333577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1184/2349] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:28 2021] PUT /identity/v3/projects/d5c269cec95d4877a39e4b97b634b904/users/2550e08247054070906ca10b2d22bd6a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:28.338840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.351465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7ba13-b8ec-457e-8a9d-64462d7c8deb service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.446308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.446993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.447273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.447581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.448924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.450523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bbb80-14a8-401d-985d-14d487222a01 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.462725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1166/2350] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:28 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:28.467555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.479181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b6b27-8bb4-4457-ab9d-86b6eedb9927 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.484140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.485045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.485354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.485630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] PATH_INFO: `/v3/projects/d5c269cec95d4877a39e4b97b634b904/users/2550e08247054070906ca10b2d22bd6a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.487585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c269cec95d4877a39e4b97b634b904, user_id=2550e08247054070906ca10b2d22bd6a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.490451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca18f-82dd-4e79-8334-4f8951f3f0c2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.501309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1185/2351] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:28 2021] PUT /identity/v3/projects/d5c269cec95d4877a39e4b97b634b904/users/2550e08247054070906ca10b2d22bd6a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:28.513958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.514177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.514452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.541402 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] MFA Rules not processed for user `2550e08247054070906ca10b2d22bd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:28.542666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:28.566383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.567211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.567824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.590066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] MFA Rules not processed for user `e2a2db05b54e45fba8475e7949a61d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:28.591282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:28.629746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1167/2352] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:28 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:28.655246 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1186/2353] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:28 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:28.673987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:28.675465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:28.736885 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5ad8-b19f-4f4a-b4d0-9e0fd9845ee8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:28.740617 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:28.741289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:28.741576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:28.741853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:28.807173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:28.811075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:28.820137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1168/2354] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:28 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:29.002490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:29.007537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.070489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82e9fb-186e-477c-9d5c-b7a0226b7683 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:29.074442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:29.075089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:29.075374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:29.075652 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:29.077424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.087207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:29.088687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:29.097253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1187/2355] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:29.477313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:29.478799 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.593580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a31ab-ad52-4796-ba36-b778ce077360 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:29.599038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:29.604420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:29.604420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:29.604420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:29.604420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.615017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:29.616836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e21fca1-1d36-4758-aeb3-bd52c94b5790 service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:29.626860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1169/2356] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:29 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:29.727323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:29.730568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.743941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d732a-b65b-4f01-a155-15499ec4af0a service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:29.749053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:29.749703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:29.749990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:29.750277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:29.752072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:29.764465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:29.766074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:29.776598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1188/2357] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:29 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:33.396094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:33.396640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:33.396874 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:33.420482 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] MFA Rules not processed for user `84e7b0c8858f4616ad809fb025ffa9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:33.421696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:33.516412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1170/2358] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:33 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:36.779585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:36.792114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b11c2-df74-4676-924f-ce5a335cfe38 service placement] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:36.796343 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:36.796964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:36.797219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:36.797493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:36.799242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:36.811071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:36.812946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5efc7-12f3-4118-ad2a-f1f0ccd6ec2a service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:36.823390 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1189/2359] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:37.666029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:37.668368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:37.690917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:37.691405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:37.692018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:37.741474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] MFA Rules not processed for user `f2206fc1fcde4dc4bc9dd24c016c2dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:37.743034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:37.787727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2854f-a8ec-4505-9e11-2a8dd018296b None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:37.804804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:37.805555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:37.809946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:37.809946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:37.811896 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:37.826723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:37.828728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:37.841667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1190/2360] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:37 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:37.842524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1171/2361] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:38.192575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:38.209243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b3aa1-3b3d-4045-9c12-fa8fa60bcd30 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:38.213954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:38.214697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:38.215049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:38.215414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:38.217799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:38.229351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:38.231911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:38.241724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1191/2362] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:38 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:39.746999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:39.758405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252a32-b323-4a1a-8c5e-ca03e2624428 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:39.762339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:39.763026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:39.763313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:39.763584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:39.773682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:39.775772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:39.786586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1172/2363] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:39 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:40.074137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:40.076117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:40.094298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392a6a7-9fe0-4d84-bd98-0a61f2c2f64f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:40.099936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:40.100624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:40.100911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:40.101190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:40.102951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:40.115494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:40.117149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4a8f1-c077-404b-9fd4-387c2d6aa54b service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:40.127655 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1192/2364] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:41.990212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:41.991652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:42.065001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d610bf-5a3f-43f1-93ec-75f0dd14c551 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:42.072763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:42.088328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:42.088328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:42.088328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] PATH_INFO: `/v3/users/7ed00f06e2bd4e62927990a64257d794` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:42.088328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed00f06e2bd4e62927990a64257d794)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:42.088328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:42.329217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed00f06e2bd4e62927990a64257d794'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:42.330138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed00f06e2bd4e62927990a64257d794'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:42.330945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed00f06e2bd4e62927990a64257d794'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:42.341437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed00f06e2bd4e62927990a64257d794'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:42.355817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed00f06e2bd4e62927990a64257d794'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:42.442608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1173/2365] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:41 2021] DELETE /identity/v3/users/7ed00f06e2bd4e62927990a64257d794 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:42.447207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:42.448606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:42.448923 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:42.467144 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:42.468469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:42.529926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1193/2366] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:42.544435 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:42.545959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:42.603391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f952fe-70b8-402a-bde4-1a77f564242f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:42.607212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:42.608225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:42.608598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:42.608955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:42.618790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:42.620332 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:42.631371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1174/2367] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:43.278783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:43.280372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:43.293167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c983755-bec2-4c35-8e15-4cae17a8e484 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:43.298113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:43.299063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:43.299418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:43.299770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] PATH_INFO: `/v3/projects/f2ca1b67b91c43ae9d4985fdf1b29c8b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:43.301091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ca1b67b91c43ae9d4985fdf1b29c8b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:43.308955 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:43.452522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ca1b67b91c43ae9d4985fdf1b29c8b', 'request_id': 'req-1fcc87e4-832c-4d86-975b-a0530fda10ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.457813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ca1b67b91c43ae9d4985fdf1b29c8b', 'request_id': 'req-1fcc87e4-832c-4d86-975b-a0530fda10ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.464183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ca1b67b91c43ae9d4985fdf1b29c8b', 'request_id': 'req-1fcc87e4-832c-4d86-975b-a0530fda10ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.536611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] The token cache is being invalidate because project f2ca1b67b91c43ae9d4985fdf1b29c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:43.536611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.536611 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.540481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1194/2368] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:43 2021] DELETE /identity/v3/projects/f2ca1b67b91c43ae9d4985fdf1b29c8b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:43.542539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:43.553081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f5158-7dfc-474d-928a-ca29758ab14c service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:43.633836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:43.635605 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:43.636005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:43.636441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] PATH_INFO: `/v3/users/bc4e62885b0a484b93fc167d1fa13a12` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:43.639042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4e62885b0a484b93fc167d1fa13a12)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:43.641804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:43.993324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4e62885b0a484b93fc167d1fa13a12'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.993975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4e62885b0a484b93fc167d1fa13a12'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:43.994658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4e62885b0a484b93fc167d1fa13a12'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:44.001424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4e62885b0a484b93fc167d1fa13a12'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:44.013280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4e62885b0a484b93fc167d1fa13a12'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:44.156880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1175/2369] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:43 2021] DELETE /identity/v3/users/bc4e62885b0a484b93fc167d1fa13a12 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:44.852867 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:44.855296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:44.873085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc87e4-832c-4d86-975b-a0530fda10ff admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:44.946740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:44.949059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:44.949405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:44.949768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] PATH_INFO: `/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:44.951827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703d44b5ba9a4a3ca305d09ab6973b90)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:44.953933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:45.182961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703d44b5ba9a4a3ca305d09ab6973b90', 'request_id': 'req-b46d4904-6113-4009-9df9-fbe5fc510207'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:45.195850 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703d44b5ba9a4a3ca305d09ab6973b90', 'request_id': 'req-b46d4904-6113-4009-9df9-fbe5fc510207'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:45.202894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703d44b5ba9a4a3ca305d09ab6973b90', 'request_id': 'req-b46d4904-6113-4009-9df9-fbe5fc510207'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:45.319860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:45.321444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:45.392160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54f196-2fbf-4d9e-ba37-3ea0e3827d68 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:45.410520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] The token cache is being invalidate because project 703d44b5ba9a4a3ca305d09ab6973b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:45.411168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:45.411695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b46d4904-6113-4009-9df9-fbe5fc510207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:45.413794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1195/2370] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:44 2021] DELETE /identity/v3/projects/703d44b5ba9a4a3ca305d09ab6973b90 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:45.419966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.420297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.422843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.445345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:45.453495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:45.457188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:45.457998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.458289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.458565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.460632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:45.533088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:45.534586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd618-c777-4299-b4ca-320a17c0aabe service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:45.545763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1176/2371] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:45 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:45.548236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1196/2372] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:45.554670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.555205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.555491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.575676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:45.579590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:45.587328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1177/2373] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:45.594813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:45.604866 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6925e-7758-4c18-a0e4-ee03c71c4876 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:45.610234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:45.610839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.611200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.611481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.612230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:44:45.619809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:45.619809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:45.626444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1197/2374] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:44:45.631130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:45.641389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfbd48-030a-468a-922a-a3a8f3c7447b None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:45.646089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:45.646750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.647035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.647316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.648002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:45.649948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:45.881886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1178/2375] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:45 2021] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:45.883139 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:45.894333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e929c-8955-4631-aa89-5aedc066c81e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:45.963445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:45.964238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:45.964779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:45.965280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:45.965978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:45.967908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.089790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1198/2376] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:45 2021] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:46.093476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.106884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99ad1d-50ca-47c4-86ad-0a48f9da5efb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.112720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.115777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:46.117509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.118736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.119593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.119593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.121336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.123790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.128761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f034b9-2a76-42b1-a6de-06ff7bf70d51 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.136074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.136786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1179/2377] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:46 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:46.137198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.137451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.137759 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] PATH_INFO: `/v3/users/7de9993723474a0e94c5a0a826bc6396` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.139030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de9993723474a0e94c5a0a826bc6396)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.140988 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.141109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.151010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096f52c-82c2-4e93-b7cb-f2add8cc4b5a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.155899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.156759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.157074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.157353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.158077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.159677 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.170461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1180/2378] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:44:46.174570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.184977 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52b10-a265-4ed0-9dc9-290231c88495 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.189824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.190746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.191043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.191321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] PATH_INFO: `/v3/projects/1100e7e3f4c74af9955511f48135c334/users/1bda391ee0dc4456b1c762bb356c0194/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.207905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1100e7e3f4c74af9955511f48135c334, user_id=1bda391ee0dc4456b1c762bb356c0194, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.210563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0717f25-33bf-49f1-8990-01978a92307f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.282552 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1181/2379] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:46 2021] PUT /identity/v3/projects/1100e7e3f4c74af9955511f48135c334/users/1bda391ee0dc4456b1c762bb356c0194/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:46.293516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.293892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.294060 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.321556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] MFA Rules not processed for user `1bda391ee0dc4456b1c762bb356c0194`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:46.324087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:46.358153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de9993723474a0e94c5a0a826bc6396'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:46.374487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de9993723474a0e94c5a0a826bc6396'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:46.395839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1182/2380] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:46 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:46.400272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.435988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de9993723474a0e94c5a0a826bc6396'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:46.436677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de9993723474a0e94c5a0a826bc6396'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:46.437357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ccb3d7ef-2ca9-4d60-ae36-00c0050b2e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de9993723474a0e94c5a0a826bc6396'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:46.451914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1199/2381] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:46 2021] DELETE /identity/v3/users/7de9993723474a0e94c5a0a826bc6396 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:46.456077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.456404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.456691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.465038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26eb11-cf7c-4d54-9e94-031c55bf1b90 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.476177 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:46.477669 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:46.528791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.530211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.530502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.530819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.531838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.542523 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.543080 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1200/2382] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:46.553506 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.555950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:46.624525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108116f9-1914-4863-ba99-bab2f79c9983 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.628701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1183/2383] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:46 2021] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:44:46.629069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.629807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.630156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.630471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.632722 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.634339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:46.640543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.641986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.653634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1201/2384] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:46.704077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044666-2a19-4ea5-9808-d722108267c6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.709422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.710306 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.710769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.711146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.712229 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.714560 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.854252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1184/2385] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:46 2021] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:46.859420 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.869298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894667ab-392d-4bb9-901c-b19db87c0e0f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.874476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.875133 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.875418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.875695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.876471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.878240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:46.888966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1202/2386] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:46.893314 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:46.903959 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1e488-5e07-4b72-b758-e47c3c88581c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:46.909051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:46.909576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:46.909858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:46.910139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] PATH_INFO: `/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63/users/8ce6be5cbee14fa1aafe963af79f378f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:46.926576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e662a290ad4fa5ad2089c1fa9f6b63, user_id=8ce6be5cbee14fa1aafe963af79f378f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:46.929748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.008129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1185/2387] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:46 2021] PUT /identity/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63/users/8ce6be5cbee14fa1aafe963af79f378f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:47.012616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.023738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c57e81-a1ce-4563-be1a-f281c11ee2bf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.101775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.102768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.103303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.104370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.105794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.108520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55062a0f-34df-466d-b6d8-392a377eca60 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.126948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1203/2388] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:47 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:47.130839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.142585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0e656-280f-4649-b9ee-501887d753f4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.148821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.150809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.150809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.150809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] PATH_INFO: `/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63/users/8ce6be5cbee14fa1aafe963af79f378f/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.152963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e662a290ad4fa5ad2089c1fa9f6b63, user_id=8ce6be5cbee14fa1aafe963af79f378f, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.157444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.171295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1186/2389] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:47 2021] PUT /identity/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63/users/8ce6be5cbee14fa1aafe963af79f378f/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:47.182232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.182642 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.183001 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.216747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] MFA Rules not processed for user `8ce6be5cbee14fa1aafe963af79f378f`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:47.218751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:47.301274 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.309051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:47.311155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1204/2390] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:47 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:47.323854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.328559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:47.398148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb007500-7034-4fc6-a974-bffb89dadebd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.403169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.403934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.404098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b31e96-cfb2-4dfe-aaf0-2e54a1da1a72 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.404575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.404790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.411111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.411976 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.412290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.412570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] PATH_INFO: `/v3/projects/b16a58a3c8c34dc7a18282fa0766356c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.413827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16a58a3c8c34dc7a18282fa0766356c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.415743 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.421366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.423057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.438573 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1205/2391] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:47 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:47.598477 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16a58a3c8c34dc7a18282fa0766356c', 'request_id': 'req-be8df05d-2365-4d9e-ae5f-14afcb249e02'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:47.609748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16a58a3c8c34dc7a18282fa0766356c', 'request_id': 'req-be8df05d-2365-4d9e-ae5f-14afcb249e02'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:47.767916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16a58a3c8c34dc7a18282fa0766356c', 'request_id': 'req-be8df05d-2365-4d9e-ae5f-14afcb249e02'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:47.779360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] The token cache is being invalidate because project b16a58a3c8c34dc7a18282fa0766356c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:47.779645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:47.780357 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:47.781925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1187/2392] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:47 2021] DELETE /identity/v3/projects/b16a58a3c8c34dc7a18282fa0766356c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:47.786070 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.797474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760875d5-b294-437d-97dd-21911ee80259 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.882834 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.883860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.884043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.884359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] PATH_INFO: `/v3/users/2550e08247054070906ca10b2d22bd6a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.885637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2550e08247054070906ca10b2d22bd6a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.887742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:47.950829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:47.953073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:47.966921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df05d-2365-4d9e-ae5f-14afcb249e02 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:47.971986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:47.973207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:47.973498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:47.980328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] PATH_INFO: `/v3/users/1bda391ee0dc4456b1c762bb356c0194` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:47.980328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bda391ee0dc4456b1c762bb356c0194)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:47.980328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:48.102236 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2550e08247054070906ca10b2d22bd6a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.116089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2550e08247054070906ca10b2d22bd6a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.201638 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2550e08247054070906ca10b2d22bd6a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.202567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2550e08247054070906ca10b2d22bd6a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.203351 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-66d7faf1-23cb-46a3-ab21-3281f2892e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2550e08247054070906ca10b2d22bd6a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.219549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1206/2393] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:47 2021] DELETE /identity/v3/users/2550e08247054070906ca10b2d22bd6a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:48.262575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bda391ee0dc4456b1c762bb356c0194'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.263533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bda391ee0dc4456b1c762bb356c0194'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.264405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bda391ee0dc4456b1c762bb356c0194'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.277374 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bda391ee0dc4456b1c762bb356c0194'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.306875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bda391ee0dc4456b1c762bb356c0194'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:48.391941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1188/2394] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:47 2021] DELETE /identity/v3/users/1bda391ee0dc4456b1c762bb356c0194 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:48.407892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:48.408355 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:48.408745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:48.429964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:48.431386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:48.506791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1207/2395] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:48.515319 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:48.517045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:48.625997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef1233-07c7-45a7-b4b0-db85bbb38755 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:48.637508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:48.638853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:48.642568 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:48.643197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:48.669570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:48.671950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08207d4a-4786-443b-ac94-8fb899895943 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:48.690224 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1189/2396] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:49.000100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:49.001734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:49.023243 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d843a19-cfdc-4753-863c-03a55e980783 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:49.032889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:49.034122 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.035338 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.036163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] PATH_INFO: `/v3/projects/d5c269cec95d4877a39e4b97b634b904` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.038204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c269cec95d4877a39e4b97b634b904)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:49.043042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:49.234128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c269cec95d4877a39e4b97b634b904', 'request_id': 'req-9e52e603-a52d-4640-be91-df14e59735b7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.240504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c269cec95d4877a39e4b97b634b904', 'request_id': 'req-9e52e603-a52d-4640-be91-df14e59735b7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.254709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c269cec95d4877a39e4b97b634b904', 'request_id': 'req-9e52e603-a52d-4640-be91-df14e59735b7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.356020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] The token cache is being invalidate because project d5c269cec95d4877a39e4b97b634b904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:49.358196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.359449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9e52e603-a52d-4640-be91-df14e59735b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.362623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1208/2397] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:48 2021] DELETE /identity/v3/projects/d5c269cec95d4877a39e4b97b634b904 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:49.369590 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.370478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.370478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.409278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:49.413392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:49.511474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1190/2398] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:49.519794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.520344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.520840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.541880 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:49.543400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:49.562579 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:49.563013 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1209/2399] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:49.564443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:49.566645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:49.581381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bef1f-e5d5-4a38-940d-cf66a1e90bfa None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:49.582184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c535-5123-48db-831e-3d8ca33bb07c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:49.587040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:49.587827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:49.589876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.590038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.590283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.590569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.590777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.591214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] PATH_INFO: `/v3/projects/1100e7e3f4c74af9955511f48135c334` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.591917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:44:49.592307 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:49.593029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1100e7e3f4c74af9955511f48135c334)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:49.594213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:49.602364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:49.622941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1191/2400] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:44:49.624745 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:49.638726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689373b-6ee1-4ca3-a5f3-89d6cf408b96 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:49.645410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:49.646190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:49.647294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:49.648035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:49.649616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:49.653195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:49.812135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1100e7e3f4c74af9955511f48135c334', 'request_id': 'req-89aaa849-0754-4c44-956d-ca4f790f78b2'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.818192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1100e7e3f4c74af9955511f48135c334', 'request_id': 'req-89aaa849-0754-4c44-956d-ca4f790f78b2'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.836282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1100e7e3f4c74af9955511f48135c334', 'request_id': 'req-89aaa849-0754-4c44-956d-ca4f790f78b2'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.883570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1192/2401] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:49 2021] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:49.887709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:49.993470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] The token cache is being invalidate because project 1100e7e3f4c74af9955511f48135c334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:49.993869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.994738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:49.997513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1210/2402] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:49 2021] DELETE /identity/v3/projects/1100e7e3f4c74af9955511f48135c334 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:50.006563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.017899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:50.025842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5632e6-7e9c-4d2e-8dbd-a5357df09ae2 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.033965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.036658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.037129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.037554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.038607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.040933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.151852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaa849-0754-4c44-956d-ca4f790f78b2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.155995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1193/2403] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:49 2021] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:44:50.157276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.158685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.159854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.160385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.160950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] PATH_INFO: `/v3/users/8ce6be5cbee14fa1aafe963af79f378f` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.162436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce6be5cbee14fa1aafe963af79f378f)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.165337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.165525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:50.192572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70dc4-6d3c-4768-afad-4822dcff911e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.214849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.215543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.215830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.216109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.216882 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.218540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.231156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1194/2404] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:50 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:50.235483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.247937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a3b4-03c6-46e3-97bc-1cd5b407eef1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.254660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.255886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.256396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.256772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.257607 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.259355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.270920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1195/2405] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:44:50.275050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.285972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d980b-55b2-4309-af2b-1f12960e89ed admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.291462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.293323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.293323 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.295575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] PATH_INFO: `/v3/projects/11893874a88c45aa890e80b4d784ebc4/users/5f6dc2c8478f4f3798c01003676b4899/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.317103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11893874a88c45aa890e80b4d784ebc4, user_id=5f6dc2c8478f4f3798c01003676b4899, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.319872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c866f-0ed8-4bc7-af26-ab7bfa918332 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.420420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1196/2406] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:50 2021] PUT /identity/v3/projects/11893874a88c45aa890e80b4d784ebc4/users/5f6dc2c8478f4f3798c01003676b4899/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:50.430167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce6be5cbee14fa1aafe963af79f378f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:50.432994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.433427 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.433715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.445219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce6be5cbee14fa1aafe963af79f378f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:50.461842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] MFA Rules not processed for user `5f6dc2c8478f4f3798c01003676b4899`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:50.463063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:50.521185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce6be5cbee14fa1aafe963af79f378f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:50.522297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce6be5cbee14fa1aafe963af79f378f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:50.523002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce6be5cbee14fa1aafe963af79f378f'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:50.540248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1211/2408] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:44:50 2021] DELETE /identity/v3/users/8ce6be5cbee14fa1aafe963af79f378f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:50.540464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1197/2408] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:50.548436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.550237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:50.640137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7c4ab-6108-420b-b706-cac5e3aeb9ba admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:50.650544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:50.652090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:50.652479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:50.653109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:50.655285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:50.660096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:50.758172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1212/2409] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:50 2021] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:50.762730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:50.906962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835378f-274b-47d5-8dce-52a4213f6a1d None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.025039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.026760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.027301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.027633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.028385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.030820 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.176429 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1198/2410] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:50 2021] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:51.180859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.194492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517a31-34d8-4d5c-a25a-79e44a533c86 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.212056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.212774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.213067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.213352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.214635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.216311 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.257333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1213/2411] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:51.261350 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.273718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494b0b-542c-4bd6-93eb-71edc5875252 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.280738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.281742 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.282192 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.282641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.283555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.286100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.301273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1199/2412] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:51 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:44:51.305952 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.317593 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f9753-86dc-457e-ac57-093fc8da862f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.326187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.327437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.327793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.328135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] PATH_INFO: `/v3/projects/31e719157861418985ebff9677b17641/users/9d90dcfd07664cbda65a4c7e63d80adb/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.345325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e719157861418985ebff9677b17641, user_id=9d90dcfd07664cbda65a4c7e63d80adb, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.348160 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41427f-c76d-4cd4-b377-5d06a3c9087a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.371290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.374852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.395721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a391f-c93d-4644-940a-ce6c59800ae4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.403424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.405754 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.406397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.406911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] PATH_INFO: `/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.410001 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e662a290ad4fa5ad2089c1fa9f6b63)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.415377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.434379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1214/2413] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:51 2021] PUT /identity/v3/projects/31e719157861418985ebff9677b17641/users/9d90dcfd07664cbda65a4c7e63d80adb/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:51.437951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.438648 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.439227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.481832 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] MFA Rules not processed for user `9d90dcfd07664cbda65a4c7e63d80adb`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:51.483496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.577820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1215/2414] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:51 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:51.582010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e662a290ad4fa5ad2089c1fa9f6b63', 'request_id': 'req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:51.582188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.586312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.590818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e662a290ad4fa5ad2089c1fa9f6b63', 'request_id': 'req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:51.664702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e662a290ad4fa5ad2089c1fa9f6b63', 'request_id': 'req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:51.691014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] The token cache is being invalidate because project a7e662a290ad4fa5ad2089c1fa9f6b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:44:51.691262 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:51.691971 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:44:51.697646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1200/2415] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:44:51 2021] DELETE /identity/v3/projects/a7e662a290ad4fa5ad2089c1fa9f6b63 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:51.697646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.697646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.707699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ba86-960e-4313-8e4c-d3a25da210dc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.784297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe0a91-8cfd-4e28-8a58-7bfeb6cfd942 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:51.791666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.792920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.793441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.793933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.795800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:51.796493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.796775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.797049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.799062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.809029 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.813556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.816634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:51.840554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaf1b5-4160-422e-8e59-63f7a71dc006 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:51.854557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1216/2416] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:51.855898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a751-1eac-44a1-80c9-3e0e042c45e4 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.856211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a751-1eac-44a1-80c9-3e0e042c45e4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.856504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182a751-1eac-44a1-80c9-3e0e042c45e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.888914 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0182a751-1eac-44a1-80c9-3e0e042c45e4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:51.890162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0182a751-1eac-44a1-80c9-3e0e042c45e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.904533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1217/2417] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:51.912531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:51.913041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:51.913169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:51.933716 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:51.934938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:51.949523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1218/2418] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:44:51.951018 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.964021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1201/2419] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:51 2021] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:51.967884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:51.968704 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37bb1d-281b-4e9f-8d4b-914163b897b6 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.064872 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.065551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.065835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.066112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.066843 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:44:52.067156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.068846 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.085738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0de69-9ad1-4b04-afbc-12c4f38e4238 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.098124 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1219/2420] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:44:52.098469 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.099128 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.099526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.099888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.100480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.101399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.103667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.110214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca435f24-ea80-4141-8fbf-6dcf8b5bf43d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.115358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.120449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.121231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.121500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.122587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.125162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.250948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1202/2421] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:51 2021] POST /identity/v3/users => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:52.252506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.270351 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e7c9b-ca97-4a1c-82fe-5b718dc4c525 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.280440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.281561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.281561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.281750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.282379 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.283982 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.305615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1220/2422] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:52 2021] POST /identity/v3/projects => generated 367 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:52.307114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.316563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1203/2423] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:52 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:44:52.317494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.334310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e45bc6-6f14-4bc4-bbb8-2a94985316bd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.421943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.423171 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.423731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.424220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] PATH_INFO: `/v3/projects/abcf328a076d4ef9af82b817c50fe8bb/users/25f39d8951e442df84fa38f8368e5f81/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.444036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcf328a076d4ef9af82b817c50fe8bb, user_id=25f39d8951e442df84fa38f8368e5f81, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.447473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.468647 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1671ad8-3f1c-4b64-b01a-92a43c0aa58e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.484250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.485041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.485400 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.485822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.488421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.498714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.579954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1204/2424] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:52 2021] PUT /identity/v3/projects/abcf328a076d4ef9af82b817c50fe8bb/users/25f39d8951e442df84fa38f8368e5f81/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:52.583975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.627267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1221/2425] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:52 2021] POST /identity/v3/users => generated 284 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:52.629439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.650598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bf5b6-d810-4054-b5ec-08eb07220b81 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.674683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5ad38-1aac-4b86-8508-71ded4bc057b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.679476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.680341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.680625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.681027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.681750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.683941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.700339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1205/2426] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:52 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:44:52.701417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.715380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea17257-4521-4711-a874-75ec657899bf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.721684 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.722812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.723170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.723458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] PATH_INFO: `/v3/projects/abcf328a076d4ef9af82b817c50fe8bb/users/25f39d8951e442df84fa38f8368e5f81/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.725756 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abcf328a076d4ef9af82b817c50fe8bb, user_id=25f39d8951e442df84fa38f8368e5f81, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.728420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46eee7-d69b-4a5a-bd66-e5e13fcc3732 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.730412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.731204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.731565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.732100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.733077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.735015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.740133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1206/2427] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:52 2021] PUT /identity/v3/projects/abcf328a076d4ef9af82b817c50fe8bb/users/25f39d8951e442df84fa38f8368e5f81/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:52.751868 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.755204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.755204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.755412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1222/2428] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:52 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:52.758858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.775103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba443952-7d81-42b3-bc42-662c215a8985 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.784297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] MFA Rules not processed for user `25f39d8951e442df84fa38f8368e5f81`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:52.785986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:52.847660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.848554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.848927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.849284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.850206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.852068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.865587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1223/2429] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:52 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:52.866920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.876591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1207/2430] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:52 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:52.879985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426989ac-9bef-4141-bbfa-e0fe72897ef5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.886532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.887717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.888104 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.888810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] PATH_INFO: `/v3/projects/3132c46025a1456aa78a50c2a3883d91/users/3921bca4c868418e9c38ff0c7c39f562/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:52.891022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:52.892476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:52.919748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3132c46025a1456aa78a50c2a3883d91, user_id=3921bca4c868418e9c38ff0c7c39f562, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:52.922911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b7d8-096a-4664-a96d-a7c13dfb7e11 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:52.983159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59065a-5b1e-4b98-ac0e-249d66b7fdf6 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:52.986919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:52.987610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:52.987904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:52.988312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:53.000325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:53.071544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1224/2431] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:52 2021] PUT /identity/v3/projects/3132c46025a1456aa78a50c2a3883d91/users/3921bca4c868418e9c38ff0c7c39f562/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:53.072941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:53.074666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:53.083251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:53.083583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:53.083969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:53.091681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1208/2432] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:52 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:53.155044 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] MFA Rules not processed for user `3921bca4c868418e9c38ff0c7c39f562`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:53.156339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:53.264943 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1225/2433] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:53 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:53.269199 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:53.284932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cf1a-623c-4578-9496-df0730ff36b0 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:53.357388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:53.358331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:53.358629 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:53.358913 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:53.359681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:53.361619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:53.930424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1209/2434] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:44:53 2021] POST /identity/v3/projects => generated 367 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:44:53.937313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:53.949265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c579d3-c541-44c7-a234-4f3233ea07ec None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.012736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.025231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.025231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.025231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.025231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.025231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.203032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1226/2435] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:44:53 2021] POST /identity/v3/users => generated 290 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:44:54.204041 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:54.215185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa42ba3-99f8-42d3-95f4-f97d11c242da admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.220406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.221680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.221865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.222181 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.223268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.224798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.237452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1210/2436] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:54.241562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:54.252457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df326a-e706-4b17-8af6-a5a6fd8d00a8 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.258163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.261876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.261876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.261876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] PATH_INFO: `/v3/projects/592950368fbe4ec8bc5e9ba14fca23df/users/24e226a700414824ba68d3a0134a56be/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.279732 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] RBAC: Authorizing `identity:create_grant(project_id=592950368fbe4ec8bc5e9ba14fca23df, user_id=24e226a700414824ba68d3a0134a56be, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.282639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.452540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1227/2437] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:54 2021] PUT /identity/v3/projects/592950368fbe4ec8bc5e9ba14fca23df/users/24e226a700414824ba68d3a0134a56be/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:44:54.454814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:54.467788 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203009b-d47e-4ccc-a41f-e5ec6c2256df admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.598997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.599327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.599733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.600125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.601045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.602729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfd349-6bfd-480c-8eb8-7aea3a00b0e5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.620807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1211/2438] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:44:54 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:44:54.624737 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:54.636458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43725ca1-870c-4e6d-beea-9c90f6f8221c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.642258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.643451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.643620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.643925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] PATH_INFO: `/v3/projects/592950368fbe4ec8bc5e9ba14fca23df/users/24e226a700414824ba68d3a0134a56be/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.646181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592950368fbe4ec8bc5e9ba14fca23df, user_id=24e226a700414824ba68d3a0134a56be, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.649365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.671416 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1228/2439] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:44:54 2021] PUT /identity/v3/projects/592950368fbe4ec8bc5e9ba14fca23df/users/24e226a700414824ba68d3a0134a56be/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:44:54.674984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.678713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.678713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.723017 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] MFA Rules not processed for user `24e226a700414824ba68d3a0134a56be`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:44:54.724580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:54.834347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1212/2440] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:44:54 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:44:54.842317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:54.904033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390db56-f891-43ae-b0d3-1504a9ac9c41 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:54.909513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:54.910283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:54.910801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:54.911181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:54.927226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:54.929414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:54.948758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1229/2441] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:54 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:55.126177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:55.128384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:55.141903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6409ba2-bcda-475b-8232-a3c4e0df5c8f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:55.150727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:55.152063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:55.152592 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:55.153112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:55.225279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:55.227092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:55.239583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1213/2442] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:55 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:44:56.119617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:56.128878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f746f4-2283-45a6-91d6-c84accf4430b service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:56.132507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:56.133149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:56.133629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:56.134096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:56.136393 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:44:56.205288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:56.206691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:56.216812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1230/2443] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:56 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:44:58.188121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:44:58.196693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d5e7-9550-4008-941e-84c3ff11809e service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:44:58.200380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:44:58.201012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:44:58.201296 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:44:58.201569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:44:58.264785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:44:58.266220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d28d8-3f8b-4752-b8b9-0be12cea5c60 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:44:58.276593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1214/2444] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:44:58 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:01.044172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:01.106991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40fa0-2f66-4872-8f28-b28dabf5e23d service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:01.112545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:01.113492 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:01.113778 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:01.114060 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] PATH_INFO: `/v3/users/3921bca4c868418e9c38ff0c7c39f562` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:01.115250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3921bca4c868418e9c38ff0c7c39f562)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:01.117211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:01.409547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3921bca4c868418e9c38ff0c7c39f562'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:01.421694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3921bca4c868418e9c38ff0c7c39f562'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:01.561934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3921bca4c868418e9c38ff0c7c39f562'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:01.562159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3921bca4c868418e9c38ff0c7c39f562'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:01.562812 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3921bca4c868418e9c38ff0c7c39f562'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:01.575438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1231/2445] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:01 2021] DELETE /identity/v3/users/3921bca4c868418e9c38ff0c7c39f562 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:01.580303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:01.580804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:01.580939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:01.598167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:01.599389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:01.660054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1215/2446] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:01.670479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:01.671877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:01.735821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ebdb4-edbc-4847-8894-599396ca1504 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:01.741017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:01.742179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:01.742795 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:01.743308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:01.756387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:01.758580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:01.777085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1232/2447] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:02.265083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:02.267329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:02.280657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549c80-38cc-45d8-be38-7f6e15e4b653 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:02.289624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:02.292639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:02.292639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:02.292639 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] PATH_INFO: `/v3/projects/3132c46025a1456aa78a50c2a3883d91` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:02.293126 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3132c46025a1456aa78a50c2a3883d91)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:02.295216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:02.440761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3132c46025a1456aa78a50c2a3883d91', 'request_id': 'req-62b8e8a0-7a64-4a94-9946-ef916c8a1295'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.446860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3132c46025a1456aa78a50c2a3883d91', 'request_id': 'req-62b8e8a0-7a64-4a94-9946-ef916c8a1295'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.538926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3132c46025a1456aa78a50c2a3883d91', 'request_id': 'req-62b8e8a0-7a64-4a94-9946-ef916c8a1295'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.550628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] The token cache is being invalidate because project 3132c46025a1456aa78a50c2a3883d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:02.550921 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.551555 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.553104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1216/2448] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:02 2021] DELETE /identity/v3/projects/3132c46025a1456aa78a50c2a3883d91 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:02.557434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:02.569886 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86135d-090c-40ba-b289-afbe3ea82af7 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:02.630710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:02.631783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:02.632131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:02.632497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] PATH_INFO: `/v3/users/24e226a700414824ba68d3a0134a56be` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:02.633976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e226a700414824ba68d3a0134a56be)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:02.637209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:02.928990 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e226a700414824ba68d3a0134a56be'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:02.940543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e226a700414824ba68d3a0134a56be'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.052994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e226a700414824ba68d3a0134a56be'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.053550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e226a700414824ba68d3a0134a56be'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.054170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e226a700414824ba68d3a0134a56be'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.069616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1233/2449] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:02 2021] DELETE /identity/v3/users/24e226a700414824ba68d3a0134a56be => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:03.588721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:03.590270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:03.614397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8e8a0-7a64-4a94-9946-ef916c8a1295 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:03.648908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:03.651339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:03.671628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:03.678853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:03.678853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:03.678853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] PATH_INFO: `/v3/users/5f6dc2c8478f4f3798c01003676b4899` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:03.678853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6dc2c8478f4f3798c01003676b4899)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:03.678853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:03.720714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d971f2-7262-4ae3-bdd4-ecec1eba96d4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:03.725905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:03.726951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:03.727239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:03.727576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] PATH_INFO: `/v3/projects/592950368fbe4ec8bc5e9ba14fca23df` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:03.729754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592950368fbe4ec8bc5e9ba14fca23df)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:03.732179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:03.936550 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6dc2c8478f4f3798c01003676b4899'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.937195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6dc2c8478f4f3798c01003676b4899'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.937813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6dc2c8478f4f3798c01003676b4899'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.939467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592950368fbe4ec8bc5e9ba14fca23df', 'request_id': 'req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.944571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6dc2c8478f4f3798c01003676b4899'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.946106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592950368fbe4ec8bc5e9ba14fca23df', 'request_id': 'req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.952984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592950368fbe4ec8bc5e9ba14fca23df', 'request_id': 'req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:03.957822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fed396a2-8e31-4260-ad34-61046abdd4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6dc2c8478f4f3798c01003676b4899'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:04.086890 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] The token cache is being invalidate because project 592950368fbe4ec8bc5e9ba14fca23df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:04.087261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:04.090442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-4d9c30e0-5d7f-4e03-b7bc-4ab69b76b162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:04.092741 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1234/2450] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:03 2021] DELETE /identity/v3/projects/592950368fbe4ec8bc5e9ba14fca23df => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:04.099036 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952df0-0482-4572-a64b-93a9740c1e99 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.099388 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952df0-0482-4572-a64b-93a9740c1e99 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.099676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33952df0-0482-4572-a64b-93a9740c1e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.119192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-33952df0-0482-4572-a64b-93a9740c1e99 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:04.120698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-33952df0-0482-4572-a64b-93a9740c1e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.176902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1235/2451] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:45:04.185885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.186180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.186467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.189762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1217/2452] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:03 2021] DELETE /identity/v3/users/5f6dc2c8478f4f3798c01003676b4899 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:04.194119 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.194409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.194696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.205709 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:04.206912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.215378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:04.216870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.277106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1236/2453] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:04.281797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.292039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1218/2454] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:04.292676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8c595-657c-4be8-bc22-a2267889a9d8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.298616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.299277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.299905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.299905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.300599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:45:04.300908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.302496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.302835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.304214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.317646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1237/2455] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:45:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:45:04.318606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.328628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989728-a8e0-4fd3-a150-eaee0e5fab2f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.334594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.335510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.335797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.336071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.336915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.339899 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.362445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4766-92eb-45d2-8e8a-b26454b92b69 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.366154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.366797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.368594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.368594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.376665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.378254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.389824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1219/2456] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:45:04.435583 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1238/2457] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:04.436924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.449872 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ffbba-ffb3-495e-8445-c78dd8dbe166 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.515547 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.516256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.516551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.516844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.517591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.519508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.610835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1220/2458] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:04.612468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.626189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a09c0-4d57-48ae-ada1-a95b288f4af7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.631946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.632772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.633134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.636539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.636539 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.637238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.650435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1239/2459] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:04 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:04.654325 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.670293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1051e21-98a5-4e69-89fa-bf3566285723 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.679991 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.680723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.681011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.681294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.682603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.684446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477973e8-571a-4ca5-b238-f7eb6c02ef88 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.701077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1221/2460] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:04 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:04.701375 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.712395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc344-b9b6-4641-bde0-7608aeacaabe admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.717469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.718344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.718624 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.718902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] PATH_INFO: `/v3/projects/829c21e34b0f41f39915d33d7ecde295/users/5a4dd93203f14474805599277159deca/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.733496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829c21e34b0f41f39915d33d7ecde295, user_id=5a4dd93203f14474805599277159deca, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.736242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.847284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1240/2461] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:04 2021] PUT /identity/v3/projects/829c21e34b0f41f39915d33d7ecde295/users/5a4dd93203f14474805599277159deca/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:04.860016 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.860460 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.860832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.890211 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.892091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.900558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] MFA Rules not processed for user `5a4dd93203f14474805599277159deca`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:04.901774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:04.974184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1222/2462] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:04.979451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:04.983540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76971c97-2a97-4949-8b2b-72ec1121da56 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.988358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.989250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.989538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.989816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] PATH_INFO: `/v3/projects/11893874a88c45aa890e80b4d784ebc4` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.990556 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcffb3b-4c0c-4572-b69e-da2a597733d3 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:04.991175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11893874a88c45aa890e80b4d784ebc4)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:04.993126 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:04.995881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:04.996505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:04.996858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:04.997206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:04.998232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.000233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.117474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1223/2463] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:04 2021] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:05.123451 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.159981 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11893874a88c45aa890e80b4d784ebc4', 'request_id': 'req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.165342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11893874a88c45aa890e80b4d784ebc4', 'request_id': 'req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.171364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11893874a88c45aa890e80b4d784ebc4', 'request_id': 'req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.185945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866a33-dfbc-4ce9-97f3-6719bb178fc4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.252861 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] The token cache is being invalidate because project 11893874a88c45aa890e80b4d784ebc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:05.253071 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.253417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.253858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.254143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.254388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.254665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.255352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.256109 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1241/2464] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:04 2021] DELETE /identity/v3/projects/11893874a88c45aa890e80b4d784ebc4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:05.257520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.260598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.262364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:05.275437 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87a8f-0edb-4df9-9f03-2c15710c7ec1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.280845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.281710 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.281985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.282258 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] PATH_INFO: `/v3/users/9d90dcfd07664cbda65a4c7e63d80adb` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.283450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d90dcfd07664cbda65a4c7e63d80adb)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.285584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.403521 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1224/2465] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:05 2021] POST /identity/v3/users => generated 307 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:05.408338 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.409994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:05.422228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162393f-7468-40ec-bdc8-6776de8fe5a7 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.427166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.427825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.428133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.428428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.429147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.430731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.441066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1225/2466] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:05 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:45:05.446564 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.458696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b86015-d67c-4f0a-a16f-68cf82c44344 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.465633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.470083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.470083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.470083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] PATH_INFO: `/v3/projects/c1443ada7b53453385b3822b3d377943/users/b85c1ac8e2e84241a004f1c83beb39b1/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.488397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1443ada7b53453385b3822b3d377943, user_id=b85c1ac8e2e84241a004f1c83beb39b1, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.491034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.540911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d90dcfd07664cbda65a4c7e63d80adb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.553228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d90dcfd07664cbda65a4c7e63d80adb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.595981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1226/2467] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:05 2021] PUT /identity/v3/projects/c1443ada7b53453385b3822b3d377943/users/b85c1ac8e2e84241a004f1c83beb39b1/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:05.599786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.641561 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d90dcfd07664cbda65a4c7e63d80adb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.642257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d90dcfd07664cbda65a4c7e63d80adb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.643127 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d90dcfd07664cbda65a4c7e63d80adb'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:05.658189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1242/2468] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:05 2021] DELETE /identity/v3/users/9d90dcfd07664cbda65a4c7e63d80adb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:05.671676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79deb8-3dd9-4b16-be9a-12940d0d867d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.737172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.737847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.738131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.738412 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.739130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.740769 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4128b-b515-41a1-bb69-b200d019f6f7 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.750655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1227/2469] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:05 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:45:05.754770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.756513 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:05.771847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0cf1-ee31-49d9-b8ec-bb91d4e87e8d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.777905 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:05.782309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.782309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.782309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] PATH_INFO: `/v3/projects/c1443ada7b53453385b3822b3d377943/users/b85c1ac8e2e84241a004f1c83beb39b1/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.782309 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1443ada7b53453385b3822b3d377943, user_id=b85c1ac8e2e84241a004f1c83beb39b1, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:05.783951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:05.795371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1243/2470] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:05 2021] PUT /identity/v3/projects/c1443ada7b53453385b3822b3d377943/users/b85c1ac8e2e84241a004f1c83beb39b1/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:05.805841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:05.806341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:05.806692 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:05.835570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] MFA Rules not processed for user `b85c1ac8e2e84241a004f1c83beb39b1`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:05.837791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:05.910720 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1228/2471] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:05 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:05.922703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:05.924854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:05.995818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70757b-b2f2-4c20-a23e-880ca608701b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:05.999851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:06.000617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:06.000912 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:06.001196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:06.012842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:06.014337 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:06.024181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1244/2472] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:05 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:06.173715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:06.175491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:06.245291 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5da2e-c4ca-4dea-9c80-42f2b812faee None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:06.250813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:06.251837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:06.252324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:06.252567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] PATH_INFO: `/v3/projects/31e719157861418985ebff9677b17641` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:06.254025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e719157861418985ebff9677b17641)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:06.256461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:06.303920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:06.316155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c2f63-7e91-4f0a-957a-96ae1f6bb499 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:06.320078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:06.320963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:06.321359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:06.321708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:06.324882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:06.380022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e719157861418985ebff9677b17641', 'request_id': 'req-9f4159e6-bfec-4cac-873c-faf25f60df01'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.386664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e719157861418985ebff9677b17641', 'request_id': 'req-9f4159e6-bfec-4cac-873c-faf25f60df01'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.391199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:06.392742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:06.401987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1245/2473] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:06 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:45:06.475155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e719157861418985ebff9677b17641', 'request_id': 'req-9f4159e6-bfec-4cac-873c-faf25f60df01'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.492753 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] The token cache is being invalidate because project 31e719157861418985ebff9677b17641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:06.493051 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.493721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.503216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1229/2474] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:06 2021] DELETE /identity/v3/projects/31e719157861418985ebff9677b17641 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:06.503330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:06.514996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381188ca-8978-4cd4-82cc-55cb26309515 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:06.575731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:06.576635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:06.576918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:06.577195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] PATH_INFO: `/v3/users/25f39d8951e442df84fa38f8368e5f81` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:06.578484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f39d8951e442df84fa38f8368e5f81)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:06.581317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:06.911301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f39d8951e442df84fa38f8368e5f81'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:06.923061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f39d8951e442df84fa38f8368e5f81'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.035987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f39d8951e442df84fa38f8368e5f81'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.036678 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f39d8951e442df84fa38f8368e5f81'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.037418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f39d8951e442df84fa38f8368e5f81'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.052556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1246/2475] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:06 2021] DELETE /identity/v3/users/25f39d8951e442df84fa38f8368e5f81 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:07.535855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:07.537602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:07.552255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4159e6-bfec-4cac-873c-faf25f60df01 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:07.610173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:07.611045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:07.611331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:07.611613 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] PATH_INFO: `/v3/projects/abcf328a076d4ef9af82b817c50fe8bb` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:07.612827 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abcf328a076d4ef9af82b817c50fe8bb)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:07.614733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:07.715598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcf328a076d4ef9af82b817c50fe8bb', 'request_id': 'req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.721895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcf328a076d4ef9af82b817c50fe8bb', 'request_id': 'req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.943970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcf328a076d4ef9af82b817c50fe8bb', 'request_id': 'req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.955267 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] The token cache is being invalidate because project abcf328a076d4ef9af82b817c50fe8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:07.955549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.956172 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-800ebd88-db5f-4da8-a68e-ba63bfbdbc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:07.957751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1230/2476] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:07 2021] DELETE /identity/v3/projects/abcf328a076d4ef9af82b817c50fe8bb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:15.040542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:15.042061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:15.057856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a63a-bf0b-4f59-baa1-d5526c291fa5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:15.124616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:15.125428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:15.125713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:15.125987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] PATH_INFO: `/v3/users/5a4dd93203f14474805599277159deca` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:15.127182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4dd93203f14474805599277159deca)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:15.129145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:15.356265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4dd93203f14474805599277159deca'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:15.368091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4dd93203f14474805599277159deca'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:15.446548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4dd93203f14474805599277159deca'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:15.447182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4dd93203f14474805599277159deca'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:15.447791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4dd93203f14474805599277159deca'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:15.460972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1247/2477] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:15 2021] DELETE /identity/v3/users/5a4dd93203f14474805599277159deca => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:15.466772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:15.467440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:15.467440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:15.486698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:15.490644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:15.546618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1231/2478] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:45:15.558254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:15.559847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:15.615362 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c077a2-7a1e-498c-a4a3-3bf4c0474130 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:15.618995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:15.620181 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:15.620500 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:15.620878 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:15.630750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:15.632221 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:15.642346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1248/2479] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:45:16.196480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:16.198449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:16.210573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4829-0ae9-45b6-8b2e-1d535731efeb None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:16.215911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:16.216837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:16.217257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:16.217551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] PATH_INFO: `/v3/projects/829c21e34b0f41f39915d33d7ecde295` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:16.218739 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829c21e34b0f41f39915d33d7ecde295)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:16.220676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:16.350261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829c21e34b0f41f39915d33d7ecde295', 'request_id': 'req-dfcba275-81b9-42dd-a317-2abc565587d1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.356478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829c21e34b0f41f39915d33d7ecde295', 'request_id': 'req-dfcba275-81b9-42dd-a317-2abc565587d1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.417731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829c21e34b0f41f39915d33d7ecde295', 'request_id': 'req-dfcba275-81b9-42dd-a317-2abc565587d1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.428653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] The token cache is being invalidate because project 829c21e34b0f41f39915d33d7ecde295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:16.428942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.429554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.431072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1232/2480] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:16 2021] DELETE /identity/v3/projects/829c21e34b0f41f39915d33d7ecde295 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:16.435374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:16.444869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5179d43-4682-426d-8ae2-a06f68bdff1c service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:16.529209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:16.530557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:16.531021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:16.531477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] PATH_INFO: `/v3/users/b85c1ac8e2e84241a004f1c83beb39b1` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:16.533546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85c1ac8e2e84241a004f1c83beb39b1)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:16.536913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:16.796744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85c1ac8e2e84241a004f1c83beb39b1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.811339 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85c1ac8e2e84241a004f1c83beb39b1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.937930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85c1ac8e2e84241a004f1c83beb39b1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.938564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85c1ac8e2e84241a004f1c83beb39b1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.939206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-9c1bcf75-7e31-4600-b45f-2af73cdb3dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85c1ac8e2e84241a004f1c83beb39b1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:16.952185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1249/2481] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:16 2021] DELETE /identity/v3/users/b85c1ac8e2e84241a004f1c83beb39b1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:17.490389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:17.492803 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:17.515687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcba275-81b9-42dd-a317-2abc565587d1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:17.574227 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:17.574943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:17.575222 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:17.575500 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] PATH_INFO: `/v3/projects/c1443ada7b53453385b3822b3d377943` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:17.576698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1443ada7b53453385b3822b3d377943)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:17.578603 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:17.715491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1443ada7b53453385b3822b3d377943', 'request_id': 'req-c4c059cb-b8c2-461c-b725-27c3a7da8cca'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:17.721955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1443ada7b53453385b3822b3d377943', 'request_id': 'req-c4c059cb-b8c2-461c-b725-27c3a7da8cca'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:17.818103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1443ada7b53453385b3822b3d377943', 'request_id': 'req-c4c059cb-b8c2-461c-b725-27c3a7da8cca'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:17.829215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] The token cache is being invalidate because project c1443ada7b53453385b3822b3d377943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:17.829471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:17.830130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c4c059cb-b8c2-461c-b725-27c3a7da8cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:17.832048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1233/2482] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:17 2021] DELETE /identity/v3/projects/c1443ada7b53453385b3822b3d377943 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:17.838079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:17.838556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:17.838666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:17.862806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:17.862806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:17.923786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1250/2483] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:17.931410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:17.931689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:17.932142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:17.950798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:17.951996 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:17.959845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1234/2484] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:17.964667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:17.974261 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c395844-b328-49b3-84ee-85dbbda2d9bc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:17.979094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:17.979747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:17.980032 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:17.980340 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:17.981060 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:45:17.983113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:17.983639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:17.996724 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1251/2485] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:45:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:45:18.000784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.021926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a779b-717d-4de2-907a-7531f4e6d6c5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.026805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.027597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.027699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.027956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.028685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.030618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.116009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1235/2486] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:17 2021] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:18.118556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.130203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e375a-5c96-4d37-9984-f866c02ea0d4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.188472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.189179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.189451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.189721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.190435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.192365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.298527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1252/2487] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:18 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:18.304946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.321622 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9367b4-4a64-49e2-af85-8103b33f3759 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.329075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.330116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.331096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.331096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.332294 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.335059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.353526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1236/2488] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:18 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:18.358172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.367942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bc4e7-9374-4533-adca-603c2259fb5b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.374713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.375747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.376040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.381059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.381059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.381059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f3b6-5963-43cb-ba47-0cfe46e3c2bb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.389266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1253/2489] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:45:18.393763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.404384 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e429676-02ca-4d61-af76-b71998ea5edc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.409129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.411439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.411439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.411439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] PATH_INFO: `/v3/projects/31e288f9a5484eb3b589777c3cf72e55/users/5e24b1ee23314baebe935b197b948f86/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.426260 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e288f9a5484eb3b589777c3cf72e55, user_id=5e24b1ee23314baebe935b197b948f86, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.428962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.526730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1237/2490] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:18 2021] PUT /identity/v3/projects/31e288f9a5484eb3b589777c3cf72e55/users/5e24b1ee23314baebe935b197b948f86/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:18.539163 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.539660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.540118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.571977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] MFA Rules not processed for user `5e24b1ee23314baebe935b197b948f86`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:18.573683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:18.653858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1254/2491] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:18 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:18.659985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.748694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29501e3-37cf-48b8-a1c0-dc8a67e3b23e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.755370 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.756345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.756727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.757190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.758209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.761186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:18.853387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1238/2492] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:18 2021] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:45:18.858288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:18.869184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afd9b2-c0bd-4237-8961-15023e2f35cd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:18.925739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:18.926329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:18.926617 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:18.926892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:18.927606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:18.929531 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.030027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1255/2493] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:18 2021] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:45:19.034048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:19.044685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4299af0-48df-4026-a89b-620a67f7abde admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:19.049367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:19.050027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.050316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.050596 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.051316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:19.053024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.064056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1239/2494] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:19.069010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:19.080349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d4273-3fa8-4889-b956-7442d1a773c6 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:19.090381 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:19.091341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.091625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.091901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] PATH_INFO: `/v3/projects/fd4745d652bb4188b5b1093ec4f874de/users/e407026a50bd4c6c9611dac491040d9a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.108250 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4745d652bb4188b5b1093ec4f874de, user_id=e407026a50bd4c6c9611dac491040d9a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:19.111267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.190570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1256/2495] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:19 2021] PUT /identity/v3/projects/fd4745d652bb4188b5b1093ec4f874de/users/e407026a50bd4c6c9611dac491040d9a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:19.194591 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:19.204562 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7416f-08d6-4540-b40e-9f6e29d6af73 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:19.262600 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:19.263251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.263541 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.263822 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.265197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:19.266979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b2fc0-ccb1-4aa7-9213-9406e1b37df4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.281290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1240/2496] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:19 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:19.282770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:19.294344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc6d4e-71de-4df8-8a52-40415eb717fb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:19.299234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:19.300118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.308512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.308512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] PATH_INFO: `/v3/projects/fd4745d652bb4188b5b1093ec4f874de/users/e407026a50bd4c6c9611dac491040d9a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.308512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4745d652bb4188b5b1093ec4f874de, user_id=e407026a50bd4c6c9611dac491040d9a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:19.308512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.317477 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1257/2497] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:19 2021] PUT /identity/v3/projects/fd4745d652bb4188b5b1093ec4f874de/users/e407026a50bd4c6c9611dac491040d9a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:19.327557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.327847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.328124 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.354112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] MFA Rules not processed for user `e407026a50bd4c6c9611dac491040d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:19.355302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:19.420571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1241/2498] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:19 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:19.430562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:19.432826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:19.487660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb5b8-b9e2-45d4-a217-6a227854be45 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:19.491296 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:19.491932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:19.492240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:19.492524 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:19.501816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:19.503248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605eef-8d32-4aa6-bbf4-721c9f8d4fe1 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:19.512442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1258/2499] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:19 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:20.745725 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:20.826465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f1e-a1b9-4f4a-b24d-58c24bc1e59e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:20.830987 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:20.831851 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:20.832137 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:20.832448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] PATH_INFO: `/v3/users/5e24b1ee23314baebe935b197b948f86` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:20.833624 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e24b1ee23314baebe935b197b948f86)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:20.835524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:21.078956 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e24b1ee23314baebe935b197b948f86'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:21.079947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e24b1ee23314baebe935b197b948f86'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:21.080933 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e24b1ee23314baebe935b197b948f86'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:21.089719 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e24b1ee23314baebe935b197b948f86'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:21.105215 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e24b1ee23314baebe935b197b948f86'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:21.195578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1242/2500] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:20 2021] DELETE /identity/v3/users/5e24b1ee23314baebe935b197b948f86 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:21.200158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:21.200631 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:21.200725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:21.218368 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:21.219559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:21.283062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1259/2501] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:45:21.292978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:21.294439 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:21.354733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71551b76-b0ff-4b87-bf9a-b351b19797dc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:21.358845 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:21.359489 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:21.359773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:21.360048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:21.369969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:21.371437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:21.381105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1243/2502] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:22.186501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:22.188887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:22.203421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab05a5-5f63-4e33-9a50-b4a3cfbaf5ed None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:22.208589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:22.209511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:22.209801 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:22.210192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] PATH_INFO: `/v3/projects/31e288f9a5484eb3b589777c3cf72e55` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:22.211467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e288f9a5484eb3b589777c3cf72e55)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:22.213370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:22.321916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e288f9a5484eb3b589777c3cf72e55', 'request_id': 'req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.327324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e288f9a5484eb3b589777c3cf72e55', 'request_id': 'req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.333321 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e288f9a5484eb3b589777c3cf72e55', 'request_id': 'req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.403497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] The token cache is being invalidate because project 31e288f9a5484eb3b589777c3cf72e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:22.403985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.405025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.407584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1260/2503] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:22 2021] DELETE /identity/v3/projects/31e288f9a5484eb3b589777c3cf72e55 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:22.412838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:22.427104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84498b4e-da85-48c2-afe4-a56b399a9b91 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:22.482548 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:22.483414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:22.483691 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:22.483970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] PATH_INFO: `/v3/users/e407026a50bd4c6c9611dac491040d9a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:22.485345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e407026a50bd4c6c9611dac491040d9a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:22.487270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:22.711837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e407026a50bd4c6c9611dac491040d9a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.712512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e407026a50bd4c6c9611dac491040d9a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.713668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e407026a50bd4c6c9611dac491040d9a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.720496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e407026a50bd4c6c9611dac491040d9a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.732646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-578e2f1f-3197-4fd0-9c94-86947bd0bc1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e407026a50bd4c6c9611dac491040d9a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:22.846715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1244/2504] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:22 2021] DELETE /identity/v3/users/e407026a50bd4c6c9611dac491040d9a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:23.521405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:23.522894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:23.535963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7e2a5-ee14-4fcc-b266-a3d915b2472c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:23.599063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:23.599985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:23.600301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:23.600577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] PATH_INFO: `/v3/projects/fd4745d652bb4188b5b1093ec4f874de` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:23.601767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4745d652bb4188b5b1093ec4f874de)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:23.604254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:23.751120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4745d652bb4188b5b1093ec4f874de', 'request_id': 'req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:23.757056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4745d652bb4188b5b1093ec4f874de', 'request_id': 'req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:23.763687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4745d652bb4188b5b1093ec4f874de', 'request_id': 'req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:23.886564 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] The token cache is being invalidate because project fd4745d652bb4188b5b1093ec4f874de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:23.886969 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:23.890090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-21f7f70a-ee19-46c7-a213-2f3ad4b327e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:23.890090 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1261/2505] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:23 2021] DELETE /identity/v3/projects/fd4745d652bb4188b5b1093ec4f874de => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:23.897518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:23.898037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:23.898037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:23.915694 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:23.917481 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:23.977559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1245/2506] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:23.986654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:23.986950 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:23.987234 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.008344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:24.009567 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:24.021549 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1262/2507] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:24.026026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.040073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22427492-7812-423e-8e15-0ddddcd3d5e8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.045925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.050703 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.062344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1246/2508] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:45:24.066676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.076463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6ad0-7dc9-4a4e-abb9-7dfa043ac33f None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.081774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.082586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.083164 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.083548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.084365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.086357 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.185461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1263/2509] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:24 2021] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:45:24.189511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.200506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597405e-064b-4d70-a3e1-9f7c356b2164 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.258058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.258740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.259027 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.259425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.260886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.262793 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.380339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1247/2510] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:24 2021] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:45:24.384859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.398039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c8061-321a-4b6d-852e-a5087a154675 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.474876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.474876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.474876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.474876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.476898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.476898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.476898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1264/2511] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:24.488107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.498686 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdeeb4d-05ba-4ef0-8226-d2d554521d19 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.504643 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.505347 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.505634 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.505915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.506644 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.508321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12e2a3-acdf-4435-b135-0292e47c0cd0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.520261 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1248/2512] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:24.524775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.536306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b411f9-9767-42cf-a357-c95577537dd7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.541640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.542523 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.542916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.543254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] PATH_INFO: `/v3/projects/640c843532144cd4ac804d005116e62c/users/8b443000b4ae4082ac0da4f090ede3b7/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.565577 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640c843532144cd4ac804d005116e62c, user_id=8b443000b4ae4082ac0da4f090ede3b7, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.568670 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.746024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1265/2513] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:24 2021] PUT /identity/v3/projects/640c843532144cd4ac804d005116e62c/users/8b443000b4ae4082ac0da4f090ede3b7/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:45:24.752335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb535e-d9f3-4c6c-91af-5403493f06bd None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.752842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb535e-d9f3-4c6c-91af-5403493f06bd None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.753346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb535e-d9f3-4c6c-91af-5403493f06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.780054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b7eb535e-d9f3-4c6c-91af-5403493f06bd None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:24.788904 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b7eb535e-d9f3-4c6c-91af-5403493f06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:24.851728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1249/2514] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:24.862487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:24.864270 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:24.923374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6b360-6862-439f-bd1f-1fa512460902 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:24.928249 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:24.928910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:24.929198 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:24.929481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:24.939347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:24.946112 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:24.950790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1266/2515] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:45:31.219087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.219880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.219880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.262806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] MFA Rules not processed for user `8b443000b4ae4082ac0da4f090ede3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:31.268637 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:31.351631 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1250/2516] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:31.356235 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.366729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0587f8-f1af-4c69-812b-969177282f9f service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.372012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.372782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.373157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.373508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.374288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:31.376323 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:31.500913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1267/2517] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:45:31 2021] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:45:31.505217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.516928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed67232-c563-4d5a-8bba-be64ba876e36 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.573826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.574533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.574817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.575096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.575880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:31.577950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:31.721741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1251/2518] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:45:31 2021] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:45:31.725821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.736268 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8011a55-47cc-4a85-a212-9eef7b13b170 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.741063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.741723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.742010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.742288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.743010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:31.745146 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:31.755677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1268/2519] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:31.760418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.770382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a592-f6d4-4e56-9ed3-e2de3750e3e5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.775056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.775938 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.776259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.776546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] PATH_INFO: `/v3/projects/8a90442f398e4eed98b7db983952458c/users/7f46a2ca9a794d039410028fd5c4bc8c/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.790919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a90442f398e4eed98b7db983952458c, user_id=7f46a2ca9a794d039410028fd5c4bc8c, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:31.793660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:31.893089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1252/2520] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:31 2021] PUT /identity/v3/projects/8a90442f398e4eed98b7db983952458c/users/7f46a2ca9a794d039410028fd5c4bc8c/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:31.897061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.907264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cec78-0fcf-4abe-a7d9-7e561ce468eb admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.961896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.962613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.962898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.963190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.963907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:31.965547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6963a-1117-4eb5-a4c6-8a61d87fe8e8 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:31.975406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1269/2521] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:45:31.980070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:31.990738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1c1a-031d-4c4d-8e06-a47c32241bc6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:31.996061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:31.996999 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:31.997387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:31.997668 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] PATH_INFO: `/v3/projects/8a90442f398e4eed98b7db983952458c/users/7f46a2ca9a794d039410028fd5c4bc8c/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:31.999640 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a90442f398e4eed98b7db983952458c, user_id=7f46a2ca9a794d039410028fd5c4bc8c, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:32.002361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:32.013602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1253/2522] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:45:31 2021] PUT /identity/v3/projects/8a90442f398e4eed98b7db983952458c/users/7f46a2ca9a794d039410028fd5c4bc8c/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:38.795086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:38.795086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:38.795086 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:38.835347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] MFA Rules not processed for user `7f46a2ca9a794d039410028fd5c4bc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:45:38.851570 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:38.920380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1270/2523] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:45:38 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:45:38.936774 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:38.939143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:39.048678 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770bd8-0eba-4d49-b885-06df6d1035ab admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:39.060121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:39.060990 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:39.061282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:39.061573 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:39.153185 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:39.155807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:39.172146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1254/2524] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:45:38 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:45:55.618802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:55.620543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:45:55.689487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e1b5d-1aff-4e4c-8d46-d829c547e6e3 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:55.694282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:55.695158 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:55.695446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:55.695725 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] PATH_INFO: `/v3/users/f2206fc1fcde4dc4bc9dd24c016c2dbf` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:55.696977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2206fc1fcde4dc4bc9dd24c016c2dbf)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:55.698908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:56.028397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2206fc1fcde4dc4bc9dd24c016c2dbf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.030005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2206fc1fcde4dc4bc9dd24c016c2dbf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.200998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2206fc1fcde4dc4bc9dd24c016c2dbf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.201736 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2206fc1fcde4dc4bc9dd24c016c2dbf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.202408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f072aa58-5409-4689-82da-3fb6dad45fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2206fc1fcde4dc4bc9dd24c016c2dbf'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.216882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1271/2525] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:45:55 2021] DELETE /identity/v3/users/f2206fc1fcde4dc4bc9dd24c016c2dbf => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:45:56.684265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:45:56.697003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82a20e-5de7-4aa6-a02a-7989cd44eaf9 service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:45:56.795682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:45:56.796797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:45:56.797266 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:45:56.797728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] PATH_INFO: `/v3/projects/2ce125c05e8d4cb99302437ab92ffd2c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:45:56.799608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce125c05e8d4cb99302437ab92ffd2c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:45:56.802385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:45:56.933311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce125c05e8d4cb99302437ab92ffd2c', 'request_id': 'req-0e7be9fe-b67f-45a7-a024-df3c84271bc5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:56.940086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce125c05e8d4cb99302437ab92ffd2c', 'request_id': 'req-0e7be9fe-b67f-45a7-a024-df3c84271bc5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:57.092009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce125c05e8d4cb99302437ab92ffd2c', 'request_id': 'req-0e7be9fe-b67f-45a7-a024-df3c84271bc5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:57.111569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] The token cache is being invalidate because project 2ce125c05e8d4cb99302437ab92ffd2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:45:57.112170 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:57.114098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e7be9fe-b67f-45a7-a024-df3c84271bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:45:57.122152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1255/2526] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:45:56 2021] DELETE /identity/v3/projects/2ce125c05e8d4cb99302437ab92ffd2c => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:46:01.263965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:01.264550 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:01.264747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:01.267916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1272/2527] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:46:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 03:46:01.280818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656899-cb7f-40a9-9850-9dab65ea151d None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:01.281295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656899-cb7f-40a9-9850-9dab65ea151d None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:01.281398 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656899-cb7f-40a9-9850-9dab65ea151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:01.302389 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-dc656899-cb7f-40a9-9850-9dab65ea151d None None] MFA Rules not processed for user `128aae7c4c7b4d2a9bfc0eb65e1c5734`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:01.304099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-dc656899-cb7f-40a9-9850-9dab65ea151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:01.374608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1256/2528] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:46:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:01.389916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:01.392277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:01.406069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd548-9fcd-4fae-8cbc-2d239df9e8e4 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:01.409673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:01.410327 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:01.410615 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:01.410898 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:01.419108 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:01.420603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:01.428580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1273/2529] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:04.625839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dec1e-9a1b-4e2b-b1b6-ca0bee728e75 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:04.626367 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dec1e-9a1b-4e2b-b1b6-ca0bee728e75 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:04.626484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dec1e-9a1b-4e2b-b1b6-ca0bee728e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:04.644511 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a88dec1e-9a1b-4e2b-b1b6-ca0bee728e75 None None] MFA Rules not processed for user `8b443000b4ae4082ac0da4f090ede3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:04.645721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a88dec1e-9a1b-4e2b-b1b6-ca0bee728e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:04.721878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1257/2530] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:04 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:07.168380 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:07.171511 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:07.418209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24981073-a461-46f6-99f9-2bf546fed5c7 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:07.450346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:07.451932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:07.453020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:07.453833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:07.457553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:07.495107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:07.498991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:07.520698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1274/2531] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:09.974080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71d7af-97b5-4bfa-8daa-102be577e26c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:09.975503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71d7af-97b5-4bfa-8daa-102be577e26c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:09.976021 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71d7af-97b5-4bfa-8daa-102be577e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:10.009422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2b71d7af-97b5-4bfa-8daa-102be577e26c None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:10.013295 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2b71d7af-97b5-4bfa-8daa-102be577e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:10.119604 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1258/2532] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:46:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:10.171020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:10.172660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:10.300817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5fbd8-a6ed-4352-be2c-32a3ff9423d1 service nova] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:10.309031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:10.309763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:10.310045 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:10.310322 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:10.321056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:10.322947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:10.335118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1275/2533] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:46:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 03:46:20.781918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:20.783263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:20.783728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:20.809718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:20.811271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:20.820578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1259/2534] 10.222.0.21 () {58 vars in 968 bytes} [Tue Aug 10 03:46:20 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:20.850365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:20.864512 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c430c-5ae4-4c7d-a3fe-0545fb59b103 service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:20.873974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:20.875025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:20.875542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:20.876041 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:20.889419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:20.892863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:20.903509 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1276/2535] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:46:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:46:28.436700 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:28.438278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:28.450156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68ac73-d1ae-4703-938b-f7b1e9a1869e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:28.454981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:28.455744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:28.456140 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:28.456527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:28.458494 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:28.523183 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:28.525190 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:28.535173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1260/2536] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:29.186826 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:29.198170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a639f3-52d7-4c46-aff6-5e38f364bca0 service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:29.202556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:29.203178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:29.203557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:29.203743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:29.205764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:29.290498 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:29.291966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a8ff0-9130-4909-baf8-1b15c25ff5a0 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:29.305848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1277/2537] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:29 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:33.416755 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:33.419449 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:33.447881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878d98-2754-4867-8937-ff4f3dcd10c5 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:33.454458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:33.455958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:33.456516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:33.457002 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] PATH_INFO: `/v3/users/e2a2db05b54e45fba8475e7949a61d6a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:33.458821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a2db05b54e45fba8475e7949a61d6a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:33.461004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:33.579004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94972d28-8fb8-4af7-945b-1160f87bc190 None None] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:33.587971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94972d28-8fb8-4af7-945b-1160f87bc190 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:33.587971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94972d28-8fb8-4af7-945b-1160f87bc190 None None] PATH_INFO: `/` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:33.587971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1278/2538] 10.222.0.21 () {54 vars in 921 bytes} [Tue Aug 10 03:46:33 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 03:46:33.593159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:33.593742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:33.594274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:33.627742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] MFA Rules not processed for user `72464249c58f4f278dbea091c17c192a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:33.630529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:33.652137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1279/2539] 10.222.0.21 () {58 vars in 1019 bytes} [Tue Aug 10 03:46:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:46:33.661565 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:33.663331 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:33.769297 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a2db05b54e45fba8475e7949a61d6a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:33.770066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a2db05b54e45fba8475e7949a61d6a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:33.771797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a2db05b54e45fba8475e7949a61d6a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:33.796835 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e8f22-c6eb-4b64-875b-ac25686e457a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:33.801072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a2db05b54e45fba8475e7949a61d6a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:33.801428 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:33.802265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:33.802703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:33.803143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:33.807156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:33.823810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:33.826464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:33.832710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c79c7838-2e80-459c-87d0-8d5ce5493d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a2db05b54e45fba8475e7949a61d6a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:33.842229 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1280/2540] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:33.968233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1261/2541] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:46:33 2021] DELETE /identity/v3/users/e2a2db05b54e45fba8475e7949a61d6a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:34.277303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:34.278883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:34.296458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46f76d-4f2d-4348-8566-95183cef5d97 service glance] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:34.367476 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:34.368479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.369379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.369379 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] PATH_INFO: `/v3/projects/db9e9e54834e4fe682d4305010655be7` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.370486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9e9e54834e4fe682d4305010655be7)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:34.372472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:34.536568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9e9e54834e4fe682d4305010655be7', 'request_id': 'req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:34.546223 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9e9e54834e4fe682d4305010655be7', 'request_id': 'req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:34.552622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9e9e54834e4fe682d4305010655be7', 'request_id': 'req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:34.673467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] The token cache is being invalidate because project db9e9e54834e4fe682d4305010655be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:46:34.674100 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:34.674442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:34.676582 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1281/2542] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:46:34 2021] DELETE /identity/v3/projects/db9e9e54834e4fe682d4305010655be7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:34.682821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018098fe-df79-4969-85b5-39d685f9bfa0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.683317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018098fe-df79-4969-85b5-39d685f9bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.683539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018098fe-df79-4969-85b5-39d685f9bfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.685184 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:34.686608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:34.708282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-018098fe-df79-4969-85b5-39d685f9bfa0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:34.709953 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-018098fe-df79-4969-85b5-39d685f9bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:34.751869 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffc75f-9c51-45a9-8fc0-a94d01e10b05 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:34.756612 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:34.757475 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.757754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.758029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] PATH_INFO: `/v3/users/79bc1be4a0e5421aa5e8c2792f7fb05a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.759274 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bc1be4a0e5421aa5e8c2792f7fb05a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:34.761225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:34.769946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1262/2543] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:34.778265 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.778558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.778841 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.796529 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:34.797759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:34.806174 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1263/2544] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:46:34.810268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:34.818980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aac33-2923-403e-95e4-17c98d2af53a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:34.824111 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:34.824776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.825065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.825346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.826063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:46:34.826390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:34.828037 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:34.840169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1264/2545] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:46:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:46:34.844360 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:34.855670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfd25-b1a0-482a-bc03-3b3a0116bb85 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:34.861516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:34.862365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:34.862745 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:34.863240 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:34.864003 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:34.866558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.024508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bc1be4a0e5421aa5e8c2792f7fb05a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.036248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bc1be4a0e5421aa5e8c2792f7fb05a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.057627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1265/2546] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:46:34 2021] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:46:35.061817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.122362 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4f0b-d393-4dd4-bb9c-bac1e6f87146 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.127238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.127919 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.128187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.128502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.129228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.131129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.147553 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bc1be4a0e5421aa5e8c2792f7fb05a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.148179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bc1be4a0e5421aa5e8c2792f7fb05a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.149395 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bc1be4a0e5421aa5e8c2792f7fb05a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.162153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1282/2547] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:46:34 2021] DELETE /identity/v3/users/79bc1be4a0e5421aa5e8c2792f7fb05a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:35.243854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1266/2548] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:46:35 2021] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:46:35.251087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.252674 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:35.317720 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b3d9c-97fa-4f80-92d9-f42383db7855 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.322980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.323691 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.323977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.324286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.325025 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.326628 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.337017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1283/2549] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:35.341273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.351363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d6a7f-3e3b-4762-a081-6c94474eef7c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.356839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.357504 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.357840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.358121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.358848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.360459 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.370731 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1267/2550] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:35.374942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.384823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3f63d-fecb-4752-8e93-f241802987d4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.389474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.390342 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.390626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.390906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] PATH_INFO: `/v3/projects/f012432862d24610a8eb173cab23a7db/users/fdc6678984944c829a125d91bd708df5/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.406286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f012432862d24610a8eb173cab23a7db, user_id=fdc6678984944c829a125d91bd708df5, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.408963 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ece1a-79a0-412a-9f14-bb0b7c920f35 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.412954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.415377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:35.428970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e171b-0168-451b-a918-9f2a57a46f8a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.433908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.434773 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.435061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.435474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] PATH_INFO: `/v3/projects/a2ebcc2259864e7b91ab0fe1190f0f2e` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.436574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ebcc2259864e7b91ab0fe1190f0f2e)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.438479 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.542788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1284/2551] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:35 2021] PUT /identity/v3/projects/f012432862d24610a8eb173cab23a7db/users/fdc6678984944c829a125d91bd708df5/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:35.552645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.552938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.553218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.586772 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'request_id': 'req-d11a4aa4-5677-427a-85ce-3fbe43eb7500'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.587508 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] MFA Rules not processed for user `fdc6678984944c829a125d91bd708df5`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:35.588551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:35.593947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'request_id': 'req-d11a4aa4-5677-427a-85ce-3fbe43eb7500'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.655010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1285/2552] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:35 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:46:35.659747 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.719386 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754055-f1ab-48ea-b9dd-f793046a5b0b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.724287 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.724958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.725104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ebcc2259864e7b91ab0fe1190f0f2e', 'request_id': 'req-d11a4aa4-5677-427a-85ce-3fbe43eb7500'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.725496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.725496 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.726183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.728113 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.736066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] The token cache is being invalidate because project a2ebcc2259864e7b91ab0fe1190f0f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:46:35.736388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.737041 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:35.738623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1268/2553] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:46:35 2021] DELETE /identity/v3/projects/a2ebcc2259864e7b91ab0fe1190f0f2e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:35.742421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.743779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:35.756247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4aa4-5677-427a-85ce-3fbe43eb7500 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.761565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.762480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.762823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.763101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] PATH_INFO: `/v3/users/3b4840a6ddef4ad6b96a38f80c0b1dab` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.764322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4840a6ddef4ad6b96a38f80c0b1dab)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.766223 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:35.832750 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1286/2554] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:46:35 2021] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:46:35.834414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:35.836059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:35.900697 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c5b5a-69f3-4d37-b344-39a9d8d4509a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:35.905654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:35.906341 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:35.906607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:35.906882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:35.907562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:35.909501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.035595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4840a6ddef4ad6b96a38f80c0b1dab'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.036281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4840a6ddef4ad6b96a38f80c0b1dab'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.036906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4840a6ddef4ad6b96a38f80c0b1dab'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.043886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4840a6ddef4ad6b96a38f80c0b1dab'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.056263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4840a6ddef4ad6b96a38f80c0b1dab'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.067818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1287/2555] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:46:35 2021] POST /identity/v3/users => generated 309 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:46:36.069172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.071594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:36.083917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72a43f-5e41-452e-8db8-0377d16e97aa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.089099 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.094233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.094233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.094233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.094233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.094233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.103938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1288/2556] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:46:36.108252 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.119212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a7432-15e9-4cd1-b097-c1e641fcfba1 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.124353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.125345 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.125635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.125911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] PATH_INFO: `/v3/projects/bc7dca72252d42a99db713c90e96f8d7/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.141182 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7dca72252d42a99db713c90e96f8d7, user_id=14ac71c0a0cb4b2f9ad7505e4c2a1e2a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.144011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.168593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1269/2557] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:46:35 2021] DELETE /identity/v3/users/3b4840a6ddef4ad6b96a38f80c0b1dab => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:46:36.234842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1289/2558] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:36 2021] PUT /identity/v3/projects/bc7dca72252d42a99db713c90e96f8d7/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:36.238767 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.305422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb0b1a-4e82-4f7e-a517-a53683728957 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.365542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.366216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.366508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.366787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.367566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.369289 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46529-23f0-4dbd-97a6-c1a88a64b95c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.392783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1270/2559] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:36 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:36.394264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.406047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab54d2f-7d15-46fc-b1d7-b10453d49495 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.411134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.412096 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.412481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.412854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] PATH_INFO: `/v3/projects/bc7dca72252d42a99db713c90e96f8d7/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.415023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7dca72252d42a99db713c90e96f8d7, user_id=14ac71c0a0cb4b2f9ad7505e4c2a1e2a, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.417822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.431800 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1290/2560] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:36 2021] PUT /identity/v3/projects/bc7dca72252d42a99db713c90e96f8d7/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:36.441964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.442259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.442540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.463901 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.465768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:36.474487 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] MFA Rules not processed for user `14ac71c0a0cb4b2f9ad7505e4c2a1e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:36.475423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:36.544286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf904-a923-4e20-9570-180cec3a07f3 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.549282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.550222 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.550576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.551110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] PATH_INFO: `/v3/projects/e29df45c216a4d2bac97bd58e263964e` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.551248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1271/2561] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:36 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:36.552165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29df45c216a4d2bac97bd58e263964e)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.554093 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.561184 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.563150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:36.623833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ca7b9-0523-4dcd-b27f-ec5d943be9e8 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.627778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.628470 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.628760 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.629034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.638079 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.639543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:36.649514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1272/2562] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:36 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:46:36.689202 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29df45c216a4d2bac97bd58e263964e', 'request_id': 'req-74fd49b9-695d-4d56-ab21-8644b04ef5d7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.695484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29df45c216a4d2bac97bd58e263964e', 'request_id': 'req-74fd49b9-695d-4d56-ab21-8644b04ef5d7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.702918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29df45c216a4d2bac97bd58e263964e', 'request_id': 'req-74fd49b9-695d-4d56-ab21-8644b04ef5d7'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.799062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:36.810150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3c142-8190-4210-91cb-35d6018ceb6a service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:36.861816 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] The token cache is being invalidate because project e29df45c216a4d2bac97bd58e263964e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:46:36.862417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.862833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-74fd49b9-695d-4d56-ab21-8644b04ef5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:36.864433 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1291/2563] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:46:36 2021] DELETE /identity/v3/projects/e29df45c216a4d2bac97bd58e263964e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:46:36.866464 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:36.867344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:36.868241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:36.868532 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] PATH_INFO: `/v3/users/fdc6678984944c829a125d91bd708df5` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:36.869819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc6678984944c829a125d91bd708df5)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:36.871815 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:37.098566 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc6678984944c829a125d91bd708df5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:37.099225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc6678984944c829a125d91bd708df5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:37.099833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc6678984944c829a125d91bd708df5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:37.107651 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc6678984944c829a125d91bd708df5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:37.120396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-857be121-59c7-473f-ac73-e22f4f0bdc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc6678984944c829a125d91bd708df5'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:37.173105 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:37.173418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:37.173694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:37.193224 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:37.194419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:37.210944 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1273/2564] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:46:36 2021] DELETE /identity/v3/users/fdc6678984944c829a125d91bd708df5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:46:37.215667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:37.216484 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:37.216835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:37.241587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:37.241587 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:37.263024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1292/2565] 10.222.0.21 () {58 vars in 1010 bytes} [Tue Aug 10 03:46:37 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:46:37.270889 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:37.272603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:37.299236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1274/2566] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:46:37.310031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:37.311391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:37.342538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84fc39-8aa2-4edf-b24a-346db28f2e16 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:37.368065 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501b18f-c552-4d96-99ea-c0bea97db0d5 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:37.372383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:37.373097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:37.373382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:37.373658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:37.382688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:37.384176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:37.393641 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1275/2567] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:37.400056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:37.400730 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:37.401020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:37.401307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:37.455961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:37.457602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:37.466555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1293/2568] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:46:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 03:46:37.876006 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:37.877759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:37.899543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299666cb-aab7-4b1a-94c6-29767e0ad432 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:37.911608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:37.923151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:37.923709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:37.924353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] PATH_INFO: `/v3/projects/f012432862d24610a8eb173cab23a7db` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:37.925922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f012432862d24610a8eb173cab23a7db)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:37.928135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:38.103680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f012432862d24610a8eb173cab23a7db', 'request_id': 'req-aea56508-faa1-476e-a86a-789d87730a4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.110927 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f012432862d24610a8eb173cab23a7db', 'request_id': 'req-aea56508-faa1-476e-a86a-789d87730a4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.199125 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f012432862d24610a8eb173cab23a7db', 'request_id': 'req-aea56508-faa1-476e-a86a-789d87730a4d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.210169 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] The token cache is being invalidate because project f012432862d24610a8eb173cab23a7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:46:38.210461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.211121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.213225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1276/2569] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:46:37 2021] DELETE /identity/v3/projects/f012432862d24610a8eb173cab23a7db => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:38.217186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:38.227715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349001d-9e09-43a9-844b-bf19d47f10ce service swift] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:38.290150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:38.291029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:38.291354 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:38.291580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] PATH_INFO: `/v3/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:38.292977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ac71c0a0cb4b2f9ad7505e4c2a1e2a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:38.294917 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:38.505286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ac71c0a0cb4b2f9ad7505e4c2a1e2a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.518307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ac71c0a0cb4b2f9ad7505e4c2a1e2a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.599195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ac71c0a0cb4b2f9ad7505e4c2a1e2a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.599941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ac71c0a0cb4b2f9ad7505e4c2a1e2a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.600654 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-668f1bd0-3cab-43eb-82de-77e9a9765ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ac71c0a0cb4b2f9ad7505e4c2a1e2a'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:38.617374 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1294/2570] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:46:38 2021] DELETE /identity/v3/users/14ac71c0a0cb4b2f9ad7505e4c2a1e2a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:39.099509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:39.102697 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:39.172593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea56508-faa1-476e-a86a-789d87730a4d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:39.177004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:39.177869 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:39.178150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:39.178431 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] PATH_INFO: `/v3/projects/bc7dca72252d42a99db713c90e96f8d7` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:39.179618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7dca72252d42a99db713c90e96f8d7)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:39.181660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:39.562898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7dca72252d42a99db713c90e96f8d7', 'request_id': 'req-cead21e5-d3b6-4951-8399-d0b405fa2731'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:39.567696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7dca72252d42a99db713c90e96f8d7', 'request_id': 'req-cead21e5-d3b6-4951-8399-d0b405fa2731'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:39.667926 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7dca72252d42a99db713c90e96f8d7', 'request_id': 'req-cead21e5-d3b6-4951-8399-d0b405fa2731'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:39.680059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] The token cache is being invalidate because project bc7dca72252d42a99db713c90e96f8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:46:39.680454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:39.681177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-cead21e5-d3b6-4951-8399-d0b405fa2731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:46:39.688406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1277/2571] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:46:39 2021] DELETE /identity/v3/projects/bc7dca72252d42a99db713c90e96f8d7 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:46:39.690269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:39.691095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:39.691535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:39.712047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:39.713318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:39.773726 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1295/2572] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:39.781574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:39.781871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:39.782160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:39.804696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:39.806452 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:39.814602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1278/2573] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:39.818838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:39.829101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba027c3-ee0d-4348-bc7f-6b27bc9e4fa6 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:39.833848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:39.834510 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:39.834799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:39.835083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:39.835811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:46:39.836700 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:39.838299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:39.850968 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1296/2574] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:46:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:46:39.855979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:39.865762 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf23d41-3c09-439f-90da-48d20e98a8cf None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:39.870486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:39.871151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:39.871441 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:39.871724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:39.872456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:39.874383 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.018186 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1279/2575] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:46:39 2021] POST /identity/v3/projects => generated 355 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:46:40.022578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.033501 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca3339-26de-4635-a090-659f3e9a119d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.091873 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.092587 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.092868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.093145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.093833 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.095760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.200369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1297/2576] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:46:40 2021] POST /identity/v3/users => generated 278 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:46:40.204741 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.216333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bb7c9-b611-4781-a666-da02aa0be628 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.221276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.221948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.222245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.222525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.223248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.224892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.237410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1280/2577] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:40.241306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.251595 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df464b4-de95-42bb-955d-33955c8c31ec admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.256316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.257101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.257385 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.257659 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.258929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.260540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267387-81b9-4816-a21a-f1d6e49aa6a0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.271162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1298/2578] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:46:40.275825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.291221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f90bab-c7b8-4598-b988-4f3d57839981 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.291221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.292446 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.292862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.293206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] PATH_INFO: `/v3/projects/7b2b7be83d124be192d668214ce07480/users/6411f895438e41eeb174be66d8a41aa9/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.308545 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b7be83d124be192d668214ce07480, user_id=6411f895438e41eeb174be66d8a41aa9, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.311179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.405797 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1281/2579] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:40 2021] PUT /identity/v3/projects/7b2b7be83d124be192d668214ce07480/users/6411f895438e41eeb174be66d8a41aa9/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:40.416006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.416356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.416641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.443904 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] MFA Rules not processed for user `6411f895438e41eeb174be66d8a41aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:40.445253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:40.509576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1299/2580] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:40 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:40.514066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.575143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7d8f3-5554-4531-b40e-81c97f67d4cb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.579849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.580544 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.580832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.581110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.581950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.583890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.705817 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1282/2581] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:46:40 2021] POST /identity/v3/projects => generated 357 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:46:40.708372 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.718999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaad60-a65d-416d-82aa-dab6f4cc8d45 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.802656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.803584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.803811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.804120 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.805675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.807451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.910499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1300/2582] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:46:40 2021] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:46:40.914448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.925161 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fbb4-5940-49e6-a710-788ee7cd1dfc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.930312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.931019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.931301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.931581 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.932333 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.933925 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:40.945059 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1283/2583] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:40.949879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:40.963155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb5fe-5d2d-4f85-888e-d4ab4fa7680e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:40.967827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:40.968883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:40.969166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:40.969441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] PATH_INFO: `/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3/users/b7804cd9d64a4c12974132fb933c3ca3/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:40.985012 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d6e0cab48d41d3bf7e914c8a0d18a3, user_id=b7804cd9d64a4c12974132fb933c3ca3, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:40.987690 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:41.130790 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1301/2584] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:40 2021] PUT /identity/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3/users/b7804cd9d64a4c12974132fb933c3ca3/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:41.134812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:41.144960 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a3e-37b5-4558-954f-695e69ac7d1c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:41.201680 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:41.202361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:41.202652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:41.202930 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:41.203653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:41.205354 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713df47-fea5-4c1a-ab20-b102531d1223 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:41.218912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1284/2585] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:46:41 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:46:41.220072 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:41.231484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb0e7-f7d1-4d8d-b116-9bc8e5a24047 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:41.236266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:41.237159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:41.237454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:41.237733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] PATH_INFO: `/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3/users/b7804cd9d64a4c12974132fb933c3ca3/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:41.239755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d6e0cab48d41d3bf7e914c8a0d18a3, user_id=b7804cd9d64a4c12974132fb933c3ca3, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:41.242461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:41.253987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1302/2586] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:46:41 2021] PUT /identity/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3/users/b7804cd9d64a4c12974132fb933c3ca3/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:46:41.265167 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:41.265456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:41.265736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:41.295272 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] MFA Rules not processed for user `b7804cd9d64a4c12974132fb933c3ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:41.296536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:41.365053 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1285/2587] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:46:41 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:41.375442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:41.377157 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:41.435358 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89b93-982a-4177-b1ad-b3de463f92c7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:41.439425 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:41.440053 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:41.440382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:41.440658 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:41.450307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:41.451744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcecfc6-14d1-44ab-9bd4-78fc405684cb service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:41.461851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1303/2588] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:41 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:46:41.705559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:41.716458 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ce2eb-391d-4c90-8b0e-b57e722f1666 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:41.720388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:41.721070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:41.721353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:41.721628 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:41.779080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:41.780576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:41.789652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1286/2589] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:46:41 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:46:57.557810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:57.558299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:57.558403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:57.575739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] MFA Rules not processed for user `0f880afb69144cd091940c8df415e8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:46:57.577089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:57.631443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1304/2590] 10.222.0.21 () {58 vars in 968 bytes} [Tue Aug 10 03:46:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:46:57.644238 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:46:57.645693 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:46:57.712536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb162-370a-4d70-9946-4be5587a05ba service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:46:57.717594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90dad318c8b1444795b9ea36a595d70e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:46:57.718233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:46:57.718517 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:46:57.718791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:46:57.727336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:46:57.728978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d87e02-8645-497c-8e68-d78068dc0388 service swift] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:46:57.737385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1287/2591] 10.222.0.21 () {60 vars in 1385 bytes} [Tue Aug 10 03:46:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 03:47:02.302317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:02.362364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba987f-ef8b-4565-af72-a7bd069d2cd0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:02.366991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:02.367854 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:02.368137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:02.368443 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] PATH_INFO: `/v3/users/6411f895438e41eeb174be66d8a41aa9` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:02.369627 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6411f895438e41eeb174be66d8a41aa9)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:02.371545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:02.600256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6411f895438e41eeb174be66d8a41aa9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:02.612170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6411f895438e41eeb174be66d8a41aa9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:02.683927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6411f895438e41eeb174be66d8a41aa9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:02.684569 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6411f895438e41eeb174be66d8a41aa9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:02.685183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6411f895438e41eeb174be66d8a41aa9'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:02.697660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1305/2592] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:02 2021] DELETE /identity/v3/users/6411f895438e41eeb174be66d8a41aa9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:02.702232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:02.702903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:02.702903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:02.719805 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:02.721011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:02.777045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1288/2593] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:02.786882 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:02.788293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:02.843137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f77f96-8c08-4406-85c0-39070558fd18 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:02.846727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:02.847359 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:02.847643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:02.847915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:02.857976 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:02.859325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:02.868547 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1306/2594] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:03.291630 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:03.293177 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:03.305179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61efd2-8872-422d-95a4-08114a08f819 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:03.309886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:03.310747 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:03.311097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:03.311387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] PATH_INFO: `/v3/projects/7b2b7be83d124be192d668214ce07480` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:03.312669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2b7be83d124be192d668214ce07480)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:03.314710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:03.449187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2b7be83d124be192d668214ce07480', 'request_id': 'req-0880863e-414b-45c5-ac62-9572cebcb75e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.455145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2b7be83d124be192d668214ce07480', 'request_id': 'req-0880863e-414b-45c5-ac62-9572cebcb75e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.535408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2b7be83d124be192d668214ce07480', 'request_id': 'req-0880863e-414b-45c5-ac62-9572cebcb75e'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.546305 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] The token cache is being invalidate because project 7b2b7be83d124be192d668214ce07480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:03.546588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.547217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.548776 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1289/2595] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:03 2021] DELETE /identity/v3/projects/7b2b7be83d124be192d668214ce07480 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:03.552776 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:03.562466 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753758ae-7982-40fc-83c0-9a60092fdc1a service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:03.617459 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:03.618325 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:03.618621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:03.618902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] PATH_INFO: `/v3/users/b7804cd9d64a4c12974132fb933c3ca3` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:03.620079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7804cd9d64a4c12974132fb933c3ca3)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:03.622055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:03.857316 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7804cd9d64a4c12974132fb933c3ca3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.869401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7804cd9d64a4c12974132fb933c3ca3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.947643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7804cd9d64a4c12974132fb933c3ca3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.948303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7804cd9d64a4c12974132fb933c3ca3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.948921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-5dacdefd-365f-4371-b378-441c7a83d879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7804cd9d64a4c12974132fb933c3ca3'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:03.961231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1307/2596] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:03 2021] DELETE /identity/v3/users/b7804cd9d64a4c12974132fb933c3ca3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:04.434775 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:04.436361 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:04.450584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880863e-414b-45c5-ac62-9572cebcb75e admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:04.506794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:04.507646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:04.507931 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:04.508237 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] PATH_INFO: `/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:04.509410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d6e0cab48d41d3bf7e914c8a0d18a3)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:04.511302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:04.621168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d6e0cab48d41d3bf7e914c8a0d18a3', 'request_id': 'req-9fbb873d-4793-4a83-af94-9b5347163298'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:04.627488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d6e0cab48d41d3bf7e914c8a0d18a3', 'request_id': 'req-9fbb873d-4793-4a83-af94-9b5347163298'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:04.775881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d6e0cab48d41d3bf7e914c8a0d18a3', 'request_id': 'req-9fbb873d-4793-4a83-af94-9b5347163298'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:04.786478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] The token cache is being invalidate because project 38d6e0cab48d41d3bf7e914c8a0d18a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:04.786787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:04.787419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9fbb873d-4793-4a83-af94-9b5347163298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:04.789576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1290/2597] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:04 2021] DELETE /identity/v3/projects/38d6e0cab48d41d3bf7e914c8a0d18a3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:04.797294 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:04.797767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:04.797852 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:04.815537 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:04.816777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:04.873304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1308/2598] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:04.881485 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:04.881780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:04.890901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:04.901533 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:04.902736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:04.910829 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1291/2599] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:04.914945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:04.924519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9464-06d8-47fc-af9c-0983bbabf75b None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:04.929219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:04.929887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:04.930172 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:04.930450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:04.931162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:04.931469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:04.933085 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:04.944059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1309/2600] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:47:04.948664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:04.959251 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dabd4-3230-4138-b8e5-4c5d3974e535 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:04.964514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:04.965154 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:04.965436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:04.965712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:04.966397 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:04.968368 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.086440 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1292/2601] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:04 2021] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:05.090474 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.100491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732711f-bbe5-4d92-a374-982b15fad9b4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.154954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.155623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.155910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.156189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.156892 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.158842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.272301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1310/2602] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:05 2021] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:05.276486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.286652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264078b-da93-46a4-b08c-bde3a6c1c6df admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.291166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.291823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.292103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.292416 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.293152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.294764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.305410 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1293/2603] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:05.309347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.319179 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14d8a8-6c40-461b-b154-7d3169cf3cc5 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.324551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.325206 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.325495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.325775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.326491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.328077 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad2b63-9377-404f-b6a3-feac9e4e651c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.337874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1311/2604] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:05.341784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.351373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f476b08-ddfa-4264-ae89-33d9911624f3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.356715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.357937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.358230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.358620 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] PATH_INFO: `/v3/projects/db36703469b84942b658e53f2310be1b/users/13f47c7033304e5bae4b8e1c53a2a333/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.374424 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=db36703469b84942b658e53f2310be1b, user_id=13f47c7033304e5bae4b8e1c53a2a333, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.377074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.455253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1294/2605] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:05 2021] PUT /identity/v3/projects/db36703469b84942b658e53f2310be1b/users/13f47c7033304e5bae4b8e1c53a2a333/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:05.466103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.470364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.470364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.493675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] MFA Rules not processed for user `13f47c7033304e5bae4b8e1c53a2a333`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:05.494941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:05.556927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1312/2606] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:05 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:47:05.562551 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.628917 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eddfd-3ae6-48bd-bf07-9297df741fae admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.629433 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.630116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.630403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.630682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.631369 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.633324 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.702280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1295/2607] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:05 2021] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:05.706271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.716927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083a5c-161b-42df-b962-ffd57169b121 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.779125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.779793 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.780073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.780384 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.781068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.782971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.884563 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1313/2608] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:05 2021] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:05.888688 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.901225 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f292339-45f2-4473-a27e-c354c6795db4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.905884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.906540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.906826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.907104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.907819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.909448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:05.919830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1296/2609] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:05.924228 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:05.934906 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1a95-6128-4aac-ae75-0184fe597073 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:05.939620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:05.940590 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:05.940876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:05.941165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] PATH_INFO: `/v3/projects/fdb544b2ef334f37b1df8fff932020d4/users/2f09820d3d554838b3cc987765b398fa/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:05.955485 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb544b2ef334f37b1df8fff932020d4, user_id=2f09820d3d554838b3cc987765b398fa, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:05.958183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:06.038039 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1314/2610] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:05 2021] PUT /identity/v3/projects/fdb544b2ef334f37b1df8fff932020d4/users/2f09820d3d554838b3cc987765b398fa/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:06.042026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:06.051932 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c3218-611b-4302-ab7a-4d1c041e13d1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:06.107168 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:06.107835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:06.108120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:06.108428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:06.109151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:06.110737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd166b13-3ea6-4296-8815-ba5aad5a87d8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:06.120518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1297/2611] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:06 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:06.124625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:06.134838 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618b7e-df0f-40fb-ac9a-bd5a887e027b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:06.139566 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:06.140471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:06.140756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:06.141030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] PATH_INFO: `/v3/projects/fdb544b2ef334f37b1df8fff932020d4/users/2f09820d3d554838b3cc987765b398fa/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:06.143029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb544b2ef334f37b1df8fff932020d4, user_id=2f09820d3d554838b3cc987765b398fa, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:06.145685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:06.156155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1315/2612] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:06 2021] PUT /identity/v3/projects/fdb544b2ef334f37b1df8fff932020d4/users/2f09820d3d554838b3cc987765b398fa/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:06.166662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:06.166950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:06.167230 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:06.192597 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] MFA Rules not processed for user `2f09820d3d554838b3cc987765b398fa`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:06.193870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:06.259475 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1298/2613] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:06 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:47:06.269208 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:06.270888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:06.325791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf7466-0e41-487e-a5fb-588b172cd300 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:06.329731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:06.330417 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:06.330703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:06.330984 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:06.387303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:06.388693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:06.397499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1316/2614] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:06 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:12.843873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:12.845378 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:12.858081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da5808-f10f-482e-ac87-8935389c26c2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:12.861707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:12.862339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:12.862623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:12.862897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:12.872214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:12.873642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:12.883401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1299/2615] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:12 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:30.192302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:30.199254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:30.263488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860531c4-4ae1-450f-90fa-ceb8868361a2 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:30.268996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:30.269681 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:30.270069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:30.270350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:30.272155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:30.284218 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:30.285783 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd967268-38ac-4937-8580-a16564959dcf service placement] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:30.295766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1317/2616] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:40.328310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:40.328310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f24d1-5092-455f-acd3-a36a80a36157 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:40.328310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:40.328310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:40.330025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:40.330025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] PATH_INFO: `/v3/users/13f47c7033304e5bae4b8e1c53a2a333` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:40.330025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f47c7033304e5bae4b8e1c53a2a333)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:40.330025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:40.497565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f47c7033304e5bae4b8e1c53a2a333'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:40.498209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f47c7033304e5bae4b8e1c53a2a333'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:40.499010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f47c7033304e5bae4b8e1c53a2a333'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:40.505618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f47c7033304e5bae4b8e1c53a2a333'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:40.517264 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f47c7033304e5bae4b8e1c53a2a333'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:40.660110 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1300/2617] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:40 2021] DELETE /identity/v3/users/13f47c7033304e5bae4b8e1c53a2a333 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:40.734996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:40.734996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:40.734996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:40.734996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:40.734996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:40.766065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1318/2618] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:40.776256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:40.777826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:40.835509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c148e-190d-498e-bba5-32075631192f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:40.839118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:40.839765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:40.840055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:40.840376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:40.851950 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:40.853813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:40.864329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1301/2619] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:41.325876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:41.327771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:41.340178 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a57119-e38b-4a7f-aea9-5d0f18c07533 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:41.345666 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:41.351155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:41.351155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:41.351155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] PATH_INFO: `/v3/projects/db36703469b84942b658e53f2310be1b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:41.351155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db36703469b84942b658e53f2310be1b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:41.351155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:41.465682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db36703469b84942b658e53f2310be1b', 'request_id': 'req-0da5022b-6c6a-4809-9448-456dc02b0c16'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.470967 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db36703469b84942b658e53f2310be1b', 'request_id': 'req-0da5022b-6c6a-4809-9448-456dc02b0c16'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.476987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db36703469b84942b658e53f2310be1b', 'request_id': 'req-0da5022b-6c6a-4809-9448-456dc02b0c16'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.528884 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] The token cache is being invalidate because project db36703469b84942b658e53f2310be1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:41.529183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.529820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.531403 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1319/2620] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:41 2021] DELETE /identity/v3/projects/db36703469b84942b658e53f2310be1b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:41.535371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:41.545423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe593577-54ee-4bad-bc54-d9cf014520b3 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:41.601804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:41.602685 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:41.602980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:41.603278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] PATH_INFO: `/v3/users/2f09820d3d554838b3cc987765b398fa` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:41.604530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f09820d3d554838b3cc987765b398fa)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:41.606681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:41.808928 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f09820d3d554838b3cc987765b398fa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.810086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f09820d3d554838b3cc987765b398fa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.810890 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f09820d3d554838b3cc987765b398fa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.818293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f09820d3d554838b3cc987765b398fa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.833491 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-8e7c07dc-f6b8-4a7b-9a1d-90aab3de2f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f09820d3d554838b3cc987765b398fa'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:41.918436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1302/2621] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:41 2021] DELETE /identity/v3/users/2f09820d3d554838b3cc987765b398fa => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:42.353718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:42.372767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:42.372767 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5022b-6c6a-4809-9448-456dc02b0c16 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:42.424951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:42.425707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:42.425989 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:42.426264 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] PATH_INFO: `/v3/projects/fdb544b2ef334f37b1df8fff932020d4` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:42.427434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb544b2ef334f37b1df8fff932020d4)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:42.429966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:42.545225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb544b2ef334f37b1df8fff932020d4', 'request_id': 'req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:42.550397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb544b2ef334f37b1df8fff932020d4', 'request_id': 'req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:42.556947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb544b2ef334f37b1df8fff932020d4', 'request_id': 'req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:42.648995 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] The token cache is being invalidate because project fdb544b2ef334f37b1df8fff932020d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:42.649283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:42.649920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-67d5e77a-8a84-44d2-9c0a-4d7355bc2860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:42.651451 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1320/2622] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:42 2021] DELETE /identity/v3/projects/fdb544b2ef334f37b1df8fff932020d4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:42.657128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:42.657612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:42.657723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:42.676665 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:42.677759 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:42.735518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1303/2623] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:42.744518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:42.744811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:42.745091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:42.763863 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:42.765083 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:42.773097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1321/2624] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:42.777381 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:42.787015 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d5f80-a97e-4d78-a42d-6ff836ef9e57 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:42.791738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:42.792414 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:42.792705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:42.792981 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:42.793696 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:42.794007 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:42.795664 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:42.807784 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1304/2625] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:47:42.812042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:42.821677 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516f4b7-a8df-4c58-aed0-739639b69966 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:42.826458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:42.827102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:42.827391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:42.827671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:42.828404 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:42.830300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:42.941958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1322/2626] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:42 2021] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:42.946783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:42.956779 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdbece-bb0b-4ba0-abab-176e445a01fe admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.013334 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.014014 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.014301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.014577 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.015288 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.017228 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.141156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1305/2627] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:42 2021] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:43.148397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.155663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070cc2-87c9-48bf-ac55-3b7256511d8e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.160281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.160928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.161212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.161486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.162225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.163803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.173935 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1323/2628] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:43 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:43.177920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.187744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd412e6-0154-4ccf-84bc-cfd809b1d25c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.192546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.193131 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.193421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.193704 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.195094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.196717 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d483966-3ba4-4817-b732-c820b818449a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.213681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1306/2629] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:43.214517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.231162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de35cc-42bb-4dab-8b57-e83320fd2a0e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.240089 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.241125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.241486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.241772 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] PATH_INFO: `/v3/projects/25662d34e936458e9c26f145d956d207/users/7762f38f64014f0cbae63c2e9914bb5d/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.259543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25662d34e936458e9c26f145d956d207, user_id=7762f38f64014f0cbae63c2e9914bb5d, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.262254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.342043 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1324/2630] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:43 2021] PUT /identity/v3/projects/25662d34e936458e9c26f145d956d207/users/7762f38f64014f0cbae63c2e9914bb5d/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:43.352730 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.353025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.353308 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.380642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] MFA Rules not processed for user `7762f38f64014f0cbae63c2e9914bb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:43.381898 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:43.444993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1307/2631] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:43 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:43.449457 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.510504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992b7fc-de8b-429a-9cd3-aca4cabd71f7 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.516055 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.516756 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.517049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.517330 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.518033 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.519965 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.610538 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1325/2632] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:43 2021] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:43.614608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.625764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f8fd-e602-4049-af3a-fb28154af042 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.680239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.680915 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.681198 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.681525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.682206 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.684103 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.815380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1308/2633] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:43 2021] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:43.828896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.840280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a141a53-d3c3-48df-8118-097f380ccf98 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.844907 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.845683 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.845974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.846254 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.846977 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.848727 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.860227 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1326/2634] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:43 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:43.864690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.875187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599994-0b38-4634-a4cd-c4c74b07530c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.879833 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.880746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.881034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.881313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] PATH_INFO: `/v3/projects/0cff1b1e1598481fbdd69bd4545be55c/users/a5506ac2398f476abee9fb6d40380846/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.896538 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff1b1e1598481fbdd69bd4545be55c, user_id=a5506ac2398f476abee9fb6d40380846, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:43.899182 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:43.924621 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:43.926499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:43.981947 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60135f22-d5b5-43f2-b9eb-c1fb52722b6c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:43.986606 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:43.987286 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:43.987574 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:43.987858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:43.989848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:44.032554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1309/2635] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:43 2021] PUT /identity/v3/projects/0cff1b1e1598481fbdd69bd4545be55c/users/a5506ac2398f476abee9fb6d40380846/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:44.036454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:44.046738 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:44.048635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:44.058159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1327/2636] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:47:44.098193 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17268bd-a656-42b6-b97a-fc260725401c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:44.104736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:44.105736 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.106218 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.106432 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.106978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:44.108715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107842f-c500-456f-aa52-1d7f0d3fa691 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:44.120979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1310/2637] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:44 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:44.125610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:44.140915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a86194-1f18-4f04-82b7-6382d4e4b747 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:44.147106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:44.148687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.149130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.149576 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] PATH_INFO: `/v3/projects/0cff1b1e1598481fbdd69bd4545be55c/users/a5506ac2398f476abee9fb6d40380846/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.152493 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff1b1e1598481fbdd69bd4545be55c, user_id=a5506ac2398f476abee9fb6d40380846, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:44.155516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:44.168263 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1328/2638] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:44 2021] PUT /identity/v3/projects/0cff1b1e1598481fbdd69bd4545be55c/users/a5506ac2398f476abee9fb6d40380846/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:44.180104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.180423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.180705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.207727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] MFA Rules not processed for user `a5506ac2398f476abee9fb6d40380846`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:44.209409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:44.289118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1311/2639] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:44 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:44.299004 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:44.300796 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:44.358986 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3de44-0660-410c-9564-965335f9acd0 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:44.363017 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:44.363667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.363972 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.364278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.373857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:44.375320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930eced-44d7-47d6-8d7f-03b9046dcd5c service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:44.385324 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1329/2640] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:44 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:44.512025 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:44.574709 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc2f8-34a4-426d-9ce9-d8dec0cab930 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:44.579330 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:44.580386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.580672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.580945 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] PATH_INFO: `/v3/users/7762f38f64014f0cbae63c2e9914bb5d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.582136 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7762f38f64014f0cbae63c2e9914bb5d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:44.584345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:44.782954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7762f38f64014f0cbae63c2e9914bb5d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:44.783763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7762f38f64014f0cbae63c2e9914bb5d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:44.784536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7762f38f64014f0cbae63c2e9914bb5d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:44.791734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7762f38f64014f0cbae63c2e9914bb5d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:44.804436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7762f38f64014f0cbae63c2e9914bb5d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:44.917750 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1312/2641] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:44 2021] DELETE /identity/v3/users/7762f38f64014f0cbae63c2e9914bb5d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:44.922267 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:44.922779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:44.922900 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:44.940679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:44.941910 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:45.007664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1330/2642] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:45.017853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:45.020009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:45.083457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9df40-0266-4c64-85e7-c389c32a10e4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:45.089122 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:45.089867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:45.090226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:45.090575 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:45.100698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:45.102226 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:45.113239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1313/2643] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:46.097630 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:46.099276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:46.114662 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d365592-32d7-4b28-b6a2-271d908c76d9 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:46.119819 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:46.120733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:46.121021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:46.121299 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] PATH_INFO: `/v3/projects/25662d34e936458e9c26f145d956d207` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:46.122544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25662d34e936458e9c26f145d956d207)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:46.129785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:46.398078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25662d34e936458e9c26f145d956d207', 'request_id': 'req-790c7e38-b025-41e4-8683-55f3bf545d09'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.403473 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25662d34e936458e9c26f145d956d207', 'request_id': 'req-790c7e38-b025-41e4-8683-55f3bf545d09'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.409597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25662d34e936458e9c26f145d956d207', 'request_id': 'req-790c7e38-b025-41e4-8683-55f3bf545d09'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.539938 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] The token cache is being invalidate because project 25662d34e936458e9c26f145d956d207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:46.540159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.540810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.542347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1331/2644] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:46 2021] DELETE /identity/v3/projects/25662d34e936458e9c26f145d956d207 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:46.546443 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:46.556189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e4a57-0a34-40b4-9771-34f8db8320b8 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:46.610423 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:46.611279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:46.611580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:46.611837 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] PATH_INFO: `/v3/users/a5506ac2398f476abee9fb6d40380846` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:46.613036 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5506ac2398f476abee9fb6d40380846)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:46.614974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:46.715300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:46.716933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:46.775711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c7e38-b025-41e4-8683-55f3bf545d09 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:46.780313 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:46.781119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:46.781470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:46.781813 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:46.783640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:46.797584 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:46.798985 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:46.800213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5506ac2398f476abee9fb6d40380846'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.804673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5506ac2398f476abee9fb6d40380846'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.804673 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5506ac2398f476abee9fb6d40380846'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.809282 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5506ac2398f476abee9fb6d40380846'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.809464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1332/2645] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:47:46.827729 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-66f5fb1b-5993-478c-b010-6b1224655c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5506ac2398f476abee9fb6d40380846'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:46.940415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1314/2646] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:46 2021] DELETE /identity/v3/users/a5506ac2398f476abee9fb6d40380846 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:47.416719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:47.420449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:47.431847 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780849f-7715-4a19-a664-c0eda9f1c491 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:47.489290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:47.490149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:47.490436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:47.490713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] PATH_INFO: `/v3/projects/0cff1b1e1598481fbdd69bd4545be55c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:47.492455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff1b1e1598481fbdd69bd4545be55c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:47.494350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:47.597824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff1b1e1598481fbdd69bd4545be55c', 'request_id': 'req-70e76617-e917-4cbf-88a7-f9a7c5436e5e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:47.604465 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff1b1e1598481fbdd69bd4545be55c', 'request_id': 'req-70e76617-e917-4cbf-88a7-f9a7c5436e5e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:47.611167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff1b1e1598481fbdd69bd4545be55c', 'request_id': 'req-70e76617-e917-4cbf-88a7-f9a7c5436e5e'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:47.717515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] The token cache is being invalidate because project 0cff1b1e1598481fbdd69bd4545be55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:47.717774 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:47.718516 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-70e76617-e917-4cbf-88a7-f9a7c5436e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:47.720087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1333/2647] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:47 2021] DELETE /identity/v3/projects/0cff1b1e1598481fbdd69bd4545be55c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:47.726213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:47.726740 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:47.726849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:47.745572 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:47.746765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:47.804764 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1315/2648] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:47:47.813803 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:47.814098 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:47.814376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:47.835708 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:47.837190 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:47.845997 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1334/2649] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:47.850542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:47.860710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d6f9-d63c-4edd-b94a-3297a480d67f None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:47.865499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:47.866436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:47.867055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:47.867197 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:47.867936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:47.868290 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:47.869891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:47.882355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1316/2650] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:47:47.902514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:47.911894 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea898f-99b6-45a3-b136-b41ed80c19a0 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:47.916645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:47.917304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:47.917585 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:47.917856 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:47.918660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:47.920822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.157373 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1335/2651] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:47 2021] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:48.159816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.171512 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db918f7c-e058-48af-9fb3-b917f1bd6b7b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.226574 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.227255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.227513 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.227796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.228518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.230687 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.359320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1317/2652] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:48 2021] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:48.364389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.378779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30418ee-f13e-4254-91a4-32b886df3d9a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.387116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.387116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.387116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.387116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.387679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.389673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.405961 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1336/2653] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:48 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:48.407392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.421863 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560461d-364a-4a02-8365-a7cb99d0eb7d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.427539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.427786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.428069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.428376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.429120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.430751 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc816a8d-5a14-48ff-9da2-a718264b184e admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.442233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1318/2654] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:48 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:48.446721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.457663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a22a4-6ae9-43c7-8a00-80e01609ee6b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.462714 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.463695 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.464048 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.464424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] PATH_INFO: `/v3/projects/3839aa26494a4faeb2572c0c99989baf/users/a2979d2ac9e04a5d8f9d11dafffd8a4c/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.480749 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3839aa26494a4faeb2572c0c99989baf, user_id=a2979d2ac9e04a5d8f9d11dafffd8a4c, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.484040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.638763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1337/2655] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:48 2021] PUT /identity/v3/projects/3839aa26494a4faeb2572c0c99989baf/users/a2979d2ac9e04a5d8f9d11dafffd8a4c/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:48.649207 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.649445 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.649723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.677221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] MFA Rules not processed for user `a2979d2ac9e04a5d8f9d11dafffd8a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:48.679022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:48.743763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1319/2656] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:48 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:48.754848 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.756849 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:48.816461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b505471-2264-4f61-aeef-d8f17e4b1700 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.820063 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.820951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.821239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.821656 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.830758 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.832277 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f054ef-9305-45b7-ad76-925c3cf81735 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:48.845875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1338/2657] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:48 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:48.867257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:48.937514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953071d4-ab83-45a1-aef4-0953ff171dfe None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:48.945606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:48.946493 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:48.946778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:48.947055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] PATH_INFO: `/v3/users/a2979d2ac9e04a5d8f9d11dafffd8a4c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:48.949071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2979d2ac9e04a5d8f9d11dafffd8a4c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:48.951496 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:49.134809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2979d2ac9e04a5d8f9d11dafffd8a4c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:49.135514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2979d2ac9e04a5d8f9d11dafffd8a4c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:49.136118 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2979d2ac9e04a5d8f9d11dafffd8a4c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:49.144033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2979d2ac9e04a5d8f9d11dafffd8a4c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:49.157860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2979d2ac9e04a5d8f9d11dafffd8a4c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:49.228670 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1320/2658] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:48 2021] DELETE /identity/v3/users/a2979d2ac9e04a5d8f9d11dafffd8a4c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:49.234329 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:49.234875 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:49.235446 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:49.256008 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:49.257422 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:49.335711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1339/2659] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:49.346954 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:49.348871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:49.421940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e7a9-8ba8-4261-ba5a-5397c937c9a4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:49.427576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:49.428937 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:49.432320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:49.432320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:49.440143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:49.441818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60bce-ff0f-4801-9399-161ad6139e3f service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:49.453022 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1321/2660] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:50.248350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:50.250507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:50.270929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda17cf-707c-4dc9-a162-cf4b875dd527 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:50.280468 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:50.281643 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.284011 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.284540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] PATH_INFO: `/v3/projects/3839aa26494a4faeb2572c0c99989baf` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.286760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3839aa26494a4faeb2572c0c99989baf)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:50.288954 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:50.474183 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3839aa26494a4faeb2572c0c99989baf', 'request_id': 'req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:50.480602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3839aa26494a4faeb2572c0c99989baf', 'request_id': 'req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:50.487155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3839aa26494a4faeb2572c0c99989baf', 'request_id': 'req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:50.558988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] The token cache is being invalidate because project 3839aa26494a4faeb2572c0c99989baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:50.559315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:50.560047 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:50.561528 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1340/2661] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:50 2021] DELETE /identity/v3/projects/3839aa26494a4faeb2572c0c99989baf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:50.567217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6371e-9b74-4a3a-a5df-6d5e9d03d4b4 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.567830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6371e-9b74-4a3a-a5df-6d5e9d03d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.567830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6371e-9b74-4a3a-a5df-6d5e9d03d4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.585707 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2ed6371e-9b74-4a3a-a5df-6d5e9d03d4b4 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:50.586924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2ed6371e-9b74-4a3a-a5df-6d5e9d03d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:50.637619 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:50.639155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:50.646619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1322/2662] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:50.658586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.658586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.658586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.692801 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:50.694162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:50.704880 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1323/2663] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 10 03:47:50.715663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:50.727690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2964dd-7282-437e-84f6-bd2e4347c080 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:50.736856 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:50.737134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f14c1e-04fd-4e14-a6d2-0de7e871f7e4 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:50.738655 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.739301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.740336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.742382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73156) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:50.742710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:50.744399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:50.747022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:50.747693 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.748027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.748344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.750266 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:50.765615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1324/2664] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:47:50.767111 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:50.768754 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:50.770365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:50.790649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cb9a6-5fdd-4983-94dd-65228ea450c8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:50.793057 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1341/2665] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:47:50.801652 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:50.803178 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:50.803862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:50.804450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:50.806399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:50.810179 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:50.930140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:50.935824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1325/2666] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:50 2021] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:50.941661 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8069-1973-4f51-afdf-7c9f50ad3c52 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.016269 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.017504 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.018034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.018542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.019497 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.021641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.158542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1342/2667] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:50 2021] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:51.164377 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.177069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fddc2a-378e-4408-8ecb-a23307d674a1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.182298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.183214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.185510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.185510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.185510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.192791 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.208365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1326/2668] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:51.213305 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.224467 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047087f-0de5-4cb5-aad1-8eac9f76922c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.230486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.231152 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.231441 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.231735 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.232712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.234470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1be070-cc90-441b-9c8b-bcba81913fbb admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.245259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1343/2669] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:51 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:51.249382 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.260646 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74211c0-24f4-477f-a7f4-4d537577e0aa admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.265780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.266681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.266969 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.267250 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] PATH_INFO: `/v3/projects/9d7089d87c7943e387bb7041d89e8d42/users/4981669e1b894cc184df53e461ed6518/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.289076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7089d87c7943e387bb7041d89e8d42, user_id=4981669e1b894cc184df53e461ed6518, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.291806 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.364786 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1327/2670] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:51 2021] PUT /identity/v3/projects/9d7089d87c7943e387bb7041d89e8d42/users/4981669e1b894cc184df53e461ed6518/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:51.375233 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.375771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.375979 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.410418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] MFA Rules not processed for user `4981669e1b894cc184df53e461ed6518`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:51.411556 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:51.475909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1344/2671] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:51 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:51.480583 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.499607 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.501257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:51.557713 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22200a4-dd65-4d49-aa49-0a37cda85b91 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.562893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.563554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.563838 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.564115 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.564875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.566839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.621312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051494cc-d250-4788-b55a-f0b1c4b8d38d None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.629216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.630733 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.631226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.632290 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] PATH_INFO: `/v3/users/84e7b0c8858f4616ad809fb025ffa9ff` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.634364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e7b0c8858f4616ad809fb025ffa9ff)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.638002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.659588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1328/2672] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:51 2021] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:51.663043 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.726241 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050b550-c005-4ec6-b4ca-618f9317f303 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.731721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.732442 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.732732 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.733067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.733883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.735853 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.832302 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1329/2673] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:51 2021] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:47:51.836151 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.845661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fa62c-4f15-4fd1-abd8-5970d7e89aa4 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.850245 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.850878 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.851160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.851434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.852139 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.853770 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.863734 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1330/2674] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:51 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:51.868419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:51.878850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b98084-f039-438d-97ad-1cc41628fe55 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:51.883699 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e7b0c8858f4616ad809fb025ffa9ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:51.886301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:51.886301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:51.886301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:51.886301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] PATH_INFO: `/v3/projects/82638e35483d44fca5185a13c5cffdb3/users/5cc4e72dc4e54bbe908a7964750664a5/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:51.897991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e7b0c8858f4616ad809fb025ffa9ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:51.906844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82638e35483d44fca5185a13c5cffdb3, user_id=5cc4e72dc4e54bbe908a7964750664a5, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:51.909580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:51.986660 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e7b0c8858f4616ad809fb025ffa9ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:51.987640 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e7b0c8858f4616ad809fb025ffa9ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:51.988472 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e7b0c8858f4616ad809fb025ffa9ff'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.008411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1345/2675] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:51 2021] DELETE /identity/v3/users/84e7b0c8858f4616ad809fb025ffa9ff => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:52.030070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1331/2676] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:51 2021] PUT /identity/v3/projects/82638e35483d44fca5185a13c5cffdb3/users/5cc4e72dc4e54bbe908a7964750664a5/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:52.038444 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.040552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.140145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bf40f-083d-4fa7-bdd9-46c4da1d022b admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.205419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.206132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.206419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.206698 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.207445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.209143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57efbe2-3e45-42c5-b0bc-bb085acb07b4 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:52.224284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1346/2677] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:52 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:52.225850 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.237205 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d90a1-7497-4904-a63a-c4b15f27b297 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.242782 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.243936 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.244421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.244724 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] PATH_INFO: `/v3/projects/82638e35483d44fca5185a13c5cffdb3/users/5cc4e72dc4e54bbe908a7964750664a5/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.247067 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=82638e35483d44fca5185a13c5cffdb3, user_id=5cc4e72dc4e54bbe908a7964750664a5, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.249914 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:52.267035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1332/2678] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:52 2021] PUT /identity/v3/projects/82638e35483d44fca5185a13c5cffdb3/users/5cc4e72dc4e54bbe908a7964750664a5/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:52.272721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.273275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.273560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.302682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] MFA Rules not processed for user `5cc4e72dc4e54bbe908a7964750664a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:52.305834 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.320239 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.322380 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.398137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1347/2679] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:52 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:47:52.404502 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b9dad-440c-4014-9dc9-28dc5a42bddc admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.408802 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.409828 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.410073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.410870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.411231 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.411586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] PATH_INFO: `/v3/projects/098d020e6c2a497a939e7c54eb5cc81a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.413456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] RBAC: Authorizing `identity:delete_project(project_id=098d020e6c2a497a939e7c54eb5cc81a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.415468 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:52.478851 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a97889-58e0-4fe2-82f1-07a4bbef3f22 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.482945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.483599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.483897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.484169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.486081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.547711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.549603 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc9d63-7744-428a-a851-eb7df0c12607 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:52.559390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098d020e6c2a497a939e7c54eb5cc81a', 'request_id': 'req-d23abda1-084c-4696-83d2-c80875ca390d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.559913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1348/2680] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:52 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:47:52.569345 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098d020e6c2a497a939e7c54eb5cc81a', 'request_id': 'req-d23abda1-084c-4696-83d2-c80875ca390d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.654847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098d020e6c2a497a939e7c54eb5cc81a', 'request_id': 'req-d23abda1-084c-4696-83d2-c80875ca390d'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.668871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] The token cache is being invalidate because project 098d020e6c2a497a939e7c54eb5cc81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:52.669543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.670094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-d23abda1-084c-4696-83d2-c80875ca390d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:52.676160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1333/2681] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:52 2021] DELETE /identity/v3/projects/098d020e6c2a497a939e7c54eb5cc81a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:52.678689 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.679129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.679486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.700081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:52.702625 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.774442 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1349/2682] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:52.782204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.782527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.782809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.802355 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:52.803602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:52.812086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1334/2683] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:52.816489 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.827214 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3a622-92c1-4607-b68b-8f2778300902 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.832994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.834067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.835027 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.835445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.836478 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:52.836958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.839079 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:52.856289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1350/2684] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:47:52.857580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:52.866873 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1354aa5-d1ba-4a59-b603-ec8baf36d994 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:52.871721 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:52.876408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:52.876408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:52.876408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:52.876408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:52.876408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.016812 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1335/2685] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:52 2021] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:53.020958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:53.031713 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8691beb-bd05-4d6f-985b-0e1cde44f09a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:53.098983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:53.099827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.100251 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.101132 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.101987 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:53.104161 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.227597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1351/2686] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:53 2021] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:53.232074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:53.244120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87756a7-4e2a-47a0-86d6-da2fc3aaed63 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:53.250392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:53.263276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.263276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.263276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.263276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:53.263276 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.270158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1336/2687] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:53 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:53.271035 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:53.281871 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f889472-8cd4-4161-a152-ad32b7d0a93d admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:53.286651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:53.287397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.287823 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.288213 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.289118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:53.290777 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ee81e-2145-420a-8c14-77d34b6c36ef admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.305087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1352/2688] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:47:53.314823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:53.317527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eac7b-4efe-414f-8ef1-4c0b21cae266 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:53.323166 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:53.324576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.324781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.325149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] PATH_INFO: `/v3/projects/526a0eb74b6948b98cd7aedee810a218/users/f4bc201979914d898bb88e4cf39d955a/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.343113 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=526a0eb74b6948b98cd7aedee810a218, user_id=f4bc201979914d898bb88e4cf39d955a, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:53.353072 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.473087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1337/2689] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:47:53 2021] PUT /identity/v3/projects/526a0eb74b6948b98cd7aedee810a218/users/f4bc201979914d898bb88e4cf39d955a/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:53.488921 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.489471 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.490125 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.529770 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] MFA Rules not processed for user `f4bc201979914d898bb88e4cf39d955a`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:53.531280 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:53.606452 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1353/2690] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:53 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:53.615344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:53.617995 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:53.696531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca324c5-ccf1-4b5a-9391-55af3de478d6 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:53.702457 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:53.703155 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:53.703444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:53.703726 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:53.712087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:53.713705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111378f-2f0e-42ff-9e20-f1465a50821b service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:53.722929 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1338/2691] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:53 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:56.227760 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:56.229600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:56.292470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10119b96-8bc1-4831-8ff1-d2d21ab481e7 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:56.297065 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:56.297932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:56.298219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:56.298520 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] PATH_INFO: `/v3/users/4981669e1b894cc184df53e461ed6518` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:56.299684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4981669e1b894cc184df53e461ed6518)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:56.301639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:56.532909 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4981669e1b894cc184df53e461ed6518'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:56.547532 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4981669e1b894cc184df53e461ed6518'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:56.660141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4981669e1b894cc184df53e461ed6518'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:56.660811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4981669e1b894cc184df53e461ed6518'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:56.661440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4981669e1b894cc184df53e461ed6518'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:56.675284 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1354/2692] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:56 2021] DELETE /identity/v3/users/4981669e1b894cc184df53e461ed6518 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:56.680010 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:56.680536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:56.680660 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:56.699052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:56.700312 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:56.760778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1339/2693] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:56.770645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:56.772646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:56.829805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a52b4e-f81e-41c7-84ff-551630863c17 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:56.833791 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:56.834988 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:56.835278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:56.835680 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:56.845116 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:56.846610 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4466-29cc-4b44-8f92-ab018c4a82b8 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:56.857723 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1355/2694] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:47:57.215737 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:57.217391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:57.231156 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96af1ca-1fc5-4daf-8946-3a048cf31e7e None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:57.236455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:57.237461 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:57.237823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:57.238150 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] PATH_INFO: `/v3/users/f4bc201979914d898bb88e4cf39d955a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:57.239506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4bc201979914d898bb88e4cf39d955a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:57.242530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:57.527594 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4bc201979914d898bb88e4cf39d955a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.529601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4bc201979914d898bb88e4cf39d955a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.529601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4bc201979914d898bb88e4cf39d955a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.536986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4bc201979914d898bb88e4cf39d955a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.551039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4bc201979914d898bb88e4cf39d955a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.677666 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1340/2695] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:57 2021] DELETE /identity/v3/users/f4bc201979914d898bb88e4cf39d955a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:57.682805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:57.683257 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:57.683398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:57.700156 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:57.701495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:57.758685 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1356/2696] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:57.765054 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:57.767209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:57.768858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:57.770554 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:57.793425 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496b2d-c09a-4fc4-a4bc-e826147e98dd admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:57.799162 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:57.810403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:57.810403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:57.810403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] PATH_INFO: `/v3/projects/9d7089d87c7943e387bb7041d89e8d42` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:57.810403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7089d87c7943e387bb7041d89e8d42)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:57.810403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:57.832551 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb210b9-5adf-496a-98bf-6cbe0ea5636e None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:57.836841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:57.837455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:57.837740 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:57.838022 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:57.847365 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:57.848857 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:57.862107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1357/2697] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:47:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:47:57.967097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7089d87c7943e387bb7041d89e8d42', 'request_id': 'req-492c91fa-601a-4a9b-93e0-8d81878d34fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:57.974525 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7089d87c7943e387bb7041d89e8d42', 'request_id': 'req-492c91fa-601a-4a9b-93e0-8d81878d34fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.128942 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7089d87c7943e387bb7041d89e8d42', 'request_id': 'req-492c91fa-601a-4a9b-93e0-8d81878d34fb'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.150510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] The token cache is being invalidate because project 9d7089d87c7943e387bb7041d89e8d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:58.151204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.151970 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.153861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1341/2698] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:57 2021] DELETE /identity/v3/projects/9d7089d87c7943e387bb7041d89e8d42 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:47:58.158210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:58.168230 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bc8da-4743-477e-b9e0-cc6aecd97414 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:58.231328 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:58.232396 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:58.232527 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:58.232798 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] PATH_INFO: `/v3/users/5cc4e72dc4e54bbe908a7964750664a5` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:58.234115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc4e72dc4e54bbe908a7964750664a5)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:58.235998 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:58.466540 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:58.468083 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:58.481317 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c91fa-601a-4a9b-93e0-8d81878d34fb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:58.491584 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:58.492599 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:58.492935 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:58.493213 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] PATH_INFO: `/v3/projects/526a0eb74b6948b98cd7aedee810a218` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:58.494582 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=526a0eb74b6948b98cd7aedee810a218)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:58.496610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:58.517076 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc4e72dc4e54bbe908a7964750664a5'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.529686 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc4e72dc4e54bbe908a7964750664a5'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.683857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '526a0eb74b6948b98cd7aedee810a218', 'request_id': 'req-b46d75f9-148b-4962-84c7-8c22837720a0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.689997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '526a0eb74b6948b98cd7aedee810a218', 'request_id': 'req-b46d75f9-148b-4962-84c7-8c22837720a0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.746069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc4e72dc4e54bbe908a7964750664a5'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.746069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc4e72dc4e54bbe908a7964750664a5'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.746069 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-00d710eb-147b-429e-aab2-93792181e7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc4e72dc4e54bbe908a7964750664a5'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:58.751021 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1358/2699] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:58 2021] DELETE /identity/v3/users/5cc4e72dc4e54bbe908a7964750664a5 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:59.009391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '526a0eb74b6948b98cd7aedee810a218', 'request_id': 'req-b46d75f9-148b-4962-84c7-8c22837720a0'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:59.022662 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] The token cache is being invalidate because project 526a0eb74b6948b98cd7aedee810a218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:47:59.022963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:59.023716 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b46d75f9-148b-4962-84c7-8c22837720a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:59.025353 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1342/2700] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:58 2021] DELETE /identity/v3/projects/526a0eb74b6948b98cd7aedee810a218 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:47:59.031188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d230-4113-45d0-a673-9624f87795dd None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.031486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d230-4113-45d0-a673-9624f87795dd None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.031829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614d230-4113-45d0-a673-9624f87795dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.054519 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-0614d230-4113-45d0-a673-9624f87795dd None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:59.055897 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-0614d230-4113-45d0-a673-9624f87795dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:59.134413 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1359/2701] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:47:59.144143 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.145316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.145809 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.176098 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:47:59.177836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:59.195204 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1343/2702] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:47:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:47:59.199888 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614d230-4113-45d0-a673-9624f87795dd None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.211150 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614d230-4113-45d0-a673-9624f87795dd None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.216930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.217753 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.218137 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.218663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.219491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:47:59.219865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.221779 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.237118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1360/2703] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:47:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 03:47:59.244749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.257505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d890d-1eba-47ef-8419-5d8a70561ad0 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.264654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.265558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.265920 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.266488 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.267419 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.269871 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.399492 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1344/2704] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:47:59 2021] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:59.416645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.416645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d330-bda4-40b6-b58e-2109e25fba2a admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.457614 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.461087 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:59.510118 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.511276 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.511728 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.512434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.514153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.516302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.544418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af5e0b-7147-4343-8bf8-56445e5f50eb admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.549129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.550056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.550601 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.550862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] PATH_INFO: `/v3/projects/82638e35483d44fca5185a13c5cffdb3` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.552061 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82638e35483d44fca5185a13c5cffdb3)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.554019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.650885 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1361/2705] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:47:59 2021] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:47:59.655115 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.665040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffbcb1-934d-4c0b-907d-a35e12dc1988 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.670091 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.670787 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.671095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.671418 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.672226 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.673870 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.683842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1362/2706] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:47:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:47:59.684821 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:47:59.686423 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:47:59.699499 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e0d6-ec47-4109-8c35-9c81d2774847 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:47:59.704288 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:47:59.705149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:47:59.705432 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:47:59.705707 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] PATH_INFO: `/v3/users/f35d508678b14f2583abf9ba5ae7fb91` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:47:59.706920 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35d508678b14f2583abf9ba5ae7fb91)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:47:59.708960 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:47:59.848088 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82638e35483d44fca5185a13c5cffdb3', 'request_id': 'req-934ec609-2a51-4bf6-a0a3-7318ab2523b8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:47:59.855522 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82638e35483d44fca5185a13c5cffdb3', 'request_id': 'req-934ec609-2a51-4bf6-a0a3-7318ab2523b8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.106256 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82638e35483d44fca5185a13c5cffdb3', 'request_id': 'req-934ec609-2a51-4bf6-a0a3-7318ab2523b8'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.129102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] The token cache is being invalidate because project 82638e35483d44fca5185a13c5cffdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:00.129102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.129102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.129102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1345/2707] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:47:59 2021] DELETE /identity/v3/projects/82638e35483d44fca5185a13c5cffdb3 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:00.129102 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.129531 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.197973 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec609-2a51-4bf6-a0a3-7318ab2523b8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.201185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35d508678b14f2583abf9ba5ae7fb91'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.204994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.206388 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.207026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.207403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.209042 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.211565 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94153627-30ce-4152-9afe-591efa2d55ce admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.213009 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35d508678b14f2583abf9ba5ae7fb91'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.223114 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1346/2708] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:00.224627 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.225011 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.225359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.249050 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:00.253968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.258281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1347/2709] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:00.259026 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.268480 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d527b-8bf5-442b-8c36-5b5703104d7c None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.273635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.274505 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.274783 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.275063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] PATH_INFO: `/v3/projects/ad21cea526594fbd8dad7bec1d356b36/users/ece4b5d1614643258071f33f10062c13/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.290862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad21cea526594fbd8dad7bec1d356b36, user_id=ece4b5d1614643258071f33f10062c13, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.293558 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f6aa-1701-48ca-9e70-46a30c43e136 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.466289 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35d508678b14f2583abf9ba5ae7fb91'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.468879 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35d508678b14f2583abf9ba5ae7fb91'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.469613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3d9c25f7-18f8-47e5-8c66-056c8003d133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35d508678b14f2583abf9ba5ae7fb91'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:00.484518 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1363/2710] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:47:59 2021] DELETE /identity/v3/users/f35d508678b14f2583abf9ba5ae7fb91 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:00.485817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.486107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.486387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.506858 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:00.508067 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.524075 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1348/2711] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:00 2021] PUT /identity/v3/projects/ad21cea526594fbd8dad7bec1d356b36/users/ece4b5d1614643258071f33f10062c13/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:00.530509 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.530924 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.531278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.570130 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] MFA Rules not processed for user `ece4b5d1614643258071f33f10062c13`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:00.572219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.590141 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1364/2712] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:00.594481 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.603916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8880c-c514-44d8-adc3-c560225dfdd2 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.662835 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1349/2713] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:00.667857 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.670405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.675463 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.676356 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.676641 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.676930 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.677684 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:48:00.678306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.679946 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.687339 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2184e-4556-4d88-a046-e256a7f58d81 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.691546 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1365/2714] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:48:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:48:00.691962 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.692825 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.693112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.693408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.694623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.696543 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.696712 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.706430 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146ead-4900-439e-9584-647ab29a7a31 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.712599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.713272 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.713560 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.713839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] PATH_INFO: `/v3/projects` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.714515 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.716529 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.885332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1366/2715] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:48:00.885534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1350/2716] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:00.886170 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.888117 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:00.889089 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:00.949242 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3d15f-0ad9-4a58-805a-e08e8f39103f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.949499 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d81d6-52bd-4769-a5e2-dbc4120b1b0b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:00.954291 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.954474 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:00.955004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.955151 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:00.955285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.955570 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.955744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:00.955916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] PATH_INFO: `/v3/projects/77aab94ffcab4a8b9ad529c5a5454ae9` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:00.956376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.957064 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77aab94ffcab4a8b9ad529c5a5454ae9)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:00.958278 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:00.958945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.104508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1351/2717] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:00 2021] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:01.104508 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.112738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237397-7f30-4e17-b41a-a365e984104f admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.118413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.119077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.119394 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.119676 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] PATH_INFO: `/v3/users` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.120387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.122300 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.145667 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77aab94ffcab4a8b9ad529c5a5454ae9', 'request_id': 'req-14054251-9f75-451d-8f72-d6a3a1963944'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.150903 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77aab94ffcab4a8b9ad529c5a5454ae9', 'request_id': 'req-14054251-9f75-451d-8f72-d6a3a1963944'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.157094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77aab94ffcab4a8b9ad529c5a5454ae9', 'request_id': 'req-14054251-9f75-451d-8f72-d6a3a1963944'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.197062 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1352/2718] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:01 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:01.197951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.207329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94d3bc-6ebb-4826-9347-f097937caae5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.270005 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.270699 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.270985 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.271259 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.272188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.274038 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.285428 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1353/2719] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:01.286466 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.296586 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b1241-7fe9-4485-be21-b26da792ca61 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.299389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] The token cache is being invalidate because project 77aab94ffcab4a8b9ad529c5a5454ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:01.299868 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.300543 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.301852 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.302397 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1367/2720] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:00 2021] DELETE /identity/v3/projects/77aab94ffcab4a8b9ad529c5a5454ae9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:01.302503 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.302765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.303134 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.303765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.304534 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.305199 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:01.310147 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.316642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1354/2721] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:01.317456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.318281 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054251-9f75-451d-8f72-d6a3a1963944 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.319144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:01.323167 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.324153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.324581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.324964 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] PATH_INFO: `/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d/users/60cea77d34654cb9a5e32a3a1930be5d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.331567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744743f-cac0-4027-9cc3-722566258a49 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.336158 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.337071 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.337352 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.337638 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] PATH_INFO: `/v3/users/40ff96bdc59246b6ae0d85bc2283651a` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.338795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ff96bdc59246b6ae0d85bc2283651a)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.339517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a7c955e51c4b2aa4dbb2b6e569d11d, user_id=60cea77d34654cb9a5e32a3a1930be5d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.340710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.342185 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.529711 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1368/2722] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:01 2021] PUT /identity/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d/users/60cea77d34654cb9a5e32a3a1930be5d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:01.530461 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.531978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:01.592896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c66b6-8059-4fa4-836a-3d5df6f9bd28 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.597650 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.598314 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.598600 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.598876 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.599620 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.601908 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.611639 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1369/2723] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:01.612458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.621575 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007c021-a257-4e33-a87a-73fc9c58e8b9 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.626319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.626936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.627219 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.627495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.628187 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.629748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.639271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1370/2724] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:01.640005 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.649945 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c156d95-a84e-42ba-b948-591a556f5296 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.654896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.655706 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.656040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.656332 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] PATH_INFO: `/v3/projects/3f376e27cf214f6ba57236aed1a897be/users/0716d00cf19a49c2b8bbdfc8bec61501/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.663795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ff96bdc59246b6ae0d85bc2283651a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.664642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ff96bdc59246b6ae0d85bc2283651a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.665406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ff96bdc59246b6ae0d85bc2283651a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.671450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f376e27cf214f6ba57236aed1a897be, user_id=0716d00cf19a49c2b8bbdfc8bec61501, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.672331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ff96bdc59246b6ae0d85bc2283651a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.674106 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.684606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-b42e24f9-3ab2-413f-94ac-f44c9b6adea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ff96bdc59246b6ae0d85bc2283651a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:01.845406 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1371/2725] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:01 2021] PUT /identity/v3/projects/3f376e27cf214f6ba57236aed1a897be/users/0716d00cf19a49c2b8bbdfc8bec61501/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:01.855874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:01.855874 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:01.894683 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1355/2726] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:01 2021] DELETE /identity/v3/users/40ff96bdc59246b6ae0d85bc2283651a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:01.896063 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.896396 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.896689 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.912797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c703c0-466b-44fb-8a3f-91d12149fd90 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:01.926514 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] MFA Rules not processed for user `0716d00cf19a49c2b8bbdfc8bec61501`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:01.927955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:01.969806 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:01.970701 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.970982 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:01.971408 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] PATH_INFO: `/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d/users/60cea77d34654cb9a5e32a3a1930be5d/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:01.973458 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a7c955e51c4b2aa4dbb2b6e569d11d, user_id=60cea77d34654cb9a5e32a3a1930be5d, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:01.976131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958acab-6e2f-4a58-9425-4e943d6cae58 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:01.987239 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1372/2727] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:01 2021] PUT /identity/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d/users/60cea77d34654cb9a5e32a3a1930be5d/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:01.997808 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1356/2728] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:01 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:01.999353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:01.999668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:02.000098 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:02.004371 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:02.005972 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:02.027346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] MFA Rules not processed for user `60cea77d34654cb9a5e32a3a1930be5d`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:02.028629 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:02.072870 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf1e76-bf24-415a-b671-fffa33dea148 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:02.106815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1373/2729] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:01 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:02.113580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:02.114634 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:02.133244 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:02.133964 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:02.134263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:02.134542 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:02.171216 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f9349-513a-4bed-a92c-92d7335d3ffc None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:02.174891 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:02.175533 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:02.175810 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:02.176087 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:02.184958 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:02.186491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:02.188947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:02.190392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:02.196165 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1374/2730] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:02 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:48:02.199986 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1357/2731] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:48:02.222948 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:02.233672 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:02.237293 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:02.297159 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb821b-67ef-4d0f-9658-44dfc651bde8 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:02.302256 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:02.303797 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:02.304082 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:02.304522 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] PATH_INFO: `/v3/users/ece4b5d1614643258071f33f10062c13` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:02.305745 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece4b5d1614643258071f33f10062c13)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:02.307782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:02.325045 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3b0ba-f2e6-4923-80a4-c3957c0310e9 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:02.330116 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:02.330993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:02.331281 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:02.331561 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] PATH_INFO: `/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:02.332839 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a73b7e0d3f94f5997106aaddb8cf5ee)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:02.335359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:02.662757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a73b7e0d3f94f5997106aaddb8cf5ee', 'request_id': 'req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.663820 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece4b5d1614643258071f33f10062c13'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.669406 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a73b7e0d3f94f5997106aaddb8cf5ee', 'request_id': 'req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.675635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece4b5d1614643258071f33f10062c13'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.871889 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a73b7e0d3f94f5997106aaddb8cf5ee', 'request_id': 'req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.882796 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] The token cache is being invalidate because project 9a73b7e0d3f94f5997106aaddb8cf5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:02.883081 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.883702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0196b5d4-f4a2-4d49-8095-a1a777ea83a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:02.885284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1358/2732] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:02 2021] DELETE /identity/v3/projects/9a73b7e0d3f94f5997106aaddb8cf5ee => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:03.020153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece4b5d1614643258071f33f10062c13'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:03.020999 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece4b5d1614643258071f33f10062c13'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:03.022175 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece4b5d1614643258071f33f10062c13'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:03.036131 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1375/2733] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:02 2021] DELETE /identity/v3/users/ece4b5d1614643258071f33f10062c13 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:03.042148 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:03.042437 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:03.042718 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:03.062085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:03.063335 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:03.123998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1359/2734] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:03.134162 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:03.135608 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:03.190535 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf07a43-f009-45b0-8f11-18282554425c admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:03.194253 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:03.194893 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:03.195192 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:03.195450 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:03.204238 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:03.205673 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:03.215455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1376/2735] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:03.737940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:03.739386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:03.752588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0dee3-7729-430e-b94a-8841edb467d2 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:03.758247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:03.760411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:03.760411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:03.760411 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] PATH_INFO: `/v3/projects/ad21cea526594fbd8dad7bec1d356b36` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:03.761012 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad21cea526594fbd8dad7bec1d356b36)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:03.762952 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:03.928895 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad21cea526594fbd8dad7bec1d356b36', 'request_id': 'req-35012ff2-3304-468d-a401-bcfd65604604'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:03.934947 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad21cea526594fbd8dad7bec1d356b36', 'request_id': 'req-35012ff2-3304-468d-a401-bcfd65604604'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.025649 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad21cea526594fbd8dad7bec1d356b36', 'request_id': 'req-35012ff2-3304-468d-a401-bcfd65604604'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.036097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] The token cache is being invalidate because project ad21cea526594fbd8dad7bec1d356b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:04.036418 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.037052 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.039187 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1360/2736] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:03 2021] DELETE /identity/v3/projects/ad21cea526594fbd8dad7bec1d356b36 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:04.043259 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:04.053436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb0c7-4c46-42e6-be13-d93e4e5f4fd9 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:04.115915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:04.115915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:04.115915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:04.115915 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] PATH_INFO: `/v3/users/60cea77d34654cb9a5e32a3a1930be5d` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:04.117134 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cea77d34654cb9a5e32a3a1930be5d)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:04.119429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:04.387645 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cea77d34654cb9a5e32a3a1930be5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.399302 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cea77d34654cb9a5e32a3a1930be5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.534391 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cea77d34654cb9a5e32a3a1930be5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.535014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cea77d34654cb9a5e32a3a1930be5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.535613 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-31de1c4a-9ed6-49b6-97e6-2e001f6c646c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cea77d34654cb9a5e32a3a1930be5d'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:04.549110 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1377/2737] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:04 2021] DELETE /identity/v3/users/60cea77d34654cb9a5e32a3a1930be5d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:05.075292 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:05.076877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:05.094121 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012ff2-3304-468d-a401-bcfd65604604 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:05.150456 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:05.151316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.151602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.151883 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] PATH_INFO: `/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.153090 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a7c955e51c4b2aa4dbb2b6e569d11d)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:05.154983 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:05.340654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a7c955e51c4b2aa4dbb2b6e569d11d', 'request_id': 'req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:05.346623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a7c955e51c4b2aa4dbb2b6e569d11d', 'request_id': 'req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:05.522610 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a7c955e51c4b2aa4dbb2b6e569d11d', 'request_id': 'req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:05.533405 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] The token cache is being invalidate because project b7a7c955e51c4b2aa4dbb2b6e569d11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:05.533695 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:05.534343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-3a445dda-7515-4d99-8f57-f2e9ecc42ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:05.535861 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1361/2738] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:05 2021] DELETE /identity/v3/projects/b7a7c955e51c4b2aa4dbb2b6e569d11d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:05.542103 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.546975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.546975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.560635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:05.561840 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:05.619360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1378/2739] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:48:05.627252 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.627537 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.627819 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.647327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:05.653951 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:05.656476 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1362/2740] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:05.660807 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:05.671062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0df112-dec2-4cd9-88c9-72876acb2244 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:05.676440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:05.677056 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.677344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.677622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.678932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:48:05.679271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:05.680940 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:05.692352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1379/2741] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:48:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:48:05.697009 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:05.706413 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec739-2fca-445b-a69f-03bf6512d050 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:05.711129 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:05.711821 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.712101 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.712417 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.713096 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:05.714978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:05.902216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1363/2742] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:05 2021] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:05.906301 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:05.916675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c2313-0aa8-486c-a142-cf13877af9bd admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:05.972068 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:05.972766 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:05.973317 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:05.973596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:05.974278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:05.976694 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.089439 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1380/2743] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:05 2021] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:06.093715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.104618 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc0650-24da-43c3-a365-491503f771ad admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.109992 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.110738 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.111085 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.111436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.112386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.113888 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.124563 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1364/2744] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:06.130273 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.140817 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45e5e-6239-4fbd-9e6c-707f51641fda admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.145742 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.146434 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.147210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.147490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.148237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.149860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad1136-4b56-436b-973c-a510885cbc75 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.159792 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1381/2745] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:06.164214 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.173911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4c09a-0966-42ac-b4c5-810e81015ad1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.178420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.179284 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.179567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.179842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] PATH_INFO: `/v3/projects/2873e572e58243079526008d5dd8fcb2/users/5992ef575ced4c03b6daaf8afebb5b3b/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.193771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2873e572e58243079526008d5dd8fcb2, user_id=5992ef575ced4c03b6daaf8afebb5b3b, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.196408 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.277580 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1365/2746] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:06 2021] PUT /identity/v3/projects/2873e572e58243079526008d5dd8fcb2/users/5992ef575ced4c03b6daaf8afebb5b3b/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:06.289209 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.289503 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.289786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.315542 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] MFA Rules not processed for user `5992ef575ced4c03b6daaf8afebb5b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:06.316769 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:06.379618 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1382/2747] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:06.384616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.443934 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dee24-a26d-4f78-a0f8-d65600b51faf admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.448520 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.449195 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.449462 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.449757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.450422 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.452316 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.541723 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1366/2748] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:06 2021] POST /identity/v3/projects => generated 393 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 03:48:06.545844 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.557210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99566e-a255-4c4a-b6f0-ac7daf181992 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.612887 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.613588 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.613877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.614155 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.614839 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.617438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.763902 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1383/2749] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:06 2021] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:06.768128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.778978 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc0d2f-8b1a-4c1e-a697-6291e2e8419b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.783450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.784092 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.784399 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.784679 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.785391 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.786975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.797698 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1367/2750] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 03:48:06.801933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.812031 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999906f-30cc-44a6-8aab-dbf8433e7030 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.816622 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.817483 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.817763 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.818037 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] PATH_INFO: `/v3/projects/2d9c8d0474014197a40e3f3310298ef8/users/ecf9a17e27914fca93b79ac3333b9525/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.833383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c8d0474014197a40e3f3310298ef8, user_id=ecf9a17e27914fca93b79ac3333b9525, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.836703 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.917398 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1384/2751] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:06 2021] PUT /identity/v3/projects/2d9c8d0474014197a40e3f3310298ef8/users/ecf9a17e27914fca93b79ac3333b9525/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:06.921403 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:06.931138 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9edab-414f-478d-bd9c-6a60bd968bc5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:06.984918 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:06.985578 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:06.985864 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:06.986142 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:06.986855 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:06.988465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815917ea-d4b3-4db7-adef-428b694c5aa5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:06.997891 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1368/2752] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:07.001956 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:07.012140 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb08e2-c59a-42de-a797-1c98a72092bf admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:07.016983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:07.017789 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] REQUEST_METHOD: `PUT` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:07.018075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:07.018346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] PATH_INFO: `/v3/projects/2d9c8d0474014197a40e3f3310298ef8/users/ecf9a17e27914fca93b79ac3333b9525/roles/cb3f52d5910b4e919a2580970bca865a` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:07.020312 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c8d0474014197a40e3f3310298ef8, user_id=ecf9a17e27914fca93b79ac3333b9525, role_id=cb3f52d5910b4e919a2580970bca865a)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:07.023409 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:07.033333 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1385/2753] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:07 2021] PUT /identity/v3/projects/2d9c8d0474014197a40e3f3310298ef8/users/ecf9a17e27914fca93b79ac3333b9525/roles/cb3f52d5910b4e919a2580970bca865a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:07.045034 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:07.045329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:07.045612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:07.073311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] MFA Rules not processed for user `ecf9a17e27914fca93b79ac3333b9525`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:07.074557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:07.152448 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1369/2754] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:07 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:48:07.162350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:07.164074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:07.218149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83a98-5d9d-4072-b588-e2295936797f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:07.221859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:07.222491 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:07.222775 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:07.223074 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:07.232679 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:07.234102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:07.243786 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1386/2755] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:07 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:07.285787 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:07.287816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:07.300733 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada37cf-5b96-45b8-a61b-309c097515b7 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:07.305248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:07.305818 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:07.306100 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:07.306376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:07.363744 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:07.365220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3cc60-96d1-43ae-9101-61e2bacc6f41 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:07.374576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1370/2756] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:07 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:15.019597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:15.080729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d218c0-1bda-4eee-b910-acb751cb03b5 service cinder] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:15.085282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:15.086143 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:15.086421 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:15.086692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] PATH_INFO: `/v3/users/5992ef575ced4c03b6daaf8afebb5b3b` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:15.087867 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5992ef575ced4c03b6daaf8afebb5b3b)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:15.089811 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:15.336097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5992ef575ced4c03b6daaf8afebb5b3b'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:15.347455 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5992ef575ced4c03b6daaf8afebb5b3b'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:15.499743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5992ef575ced4c03b6daaf8afebb5b3b'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:15.500412 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5992ef575ced4c03b6daaf8afebb5b3b'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:15.501015 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5992ef575ced4c03b6daaf8afebb5b3b'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:15.514805 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1387/2757] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:15 2021] DELETE /identity/v3/users/5992ef575ced4c03b6daaf8afebb5b3b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:15.519343 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:15.519804 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:15.519903 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:15.536471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:15.538164 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:15.595203 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1371/2758] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:15.605924 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:15.607349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:15.666589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa15fb-47a5-453c-8b12-3bcbb25bac3f admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:15.670407 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:15.671094 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:15.671376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:15.671651 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:15.681637 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:15.683059 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:15.692387 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1388/2759] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:16.238824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:16.240364 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:16.252894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba25d3-1df6-4537-be24-81a24553e79a None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:16.257455 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:16.258320 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:16.258608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:16.258908 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] PATH_INFO: `/v3/projects/2873e572e58243079526008d5dd8fcb2` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:16.260109 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2873e572e58243079526008d5dd8fcb2)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:16.262040 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:16.431518 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2873e572e58243079526008d5dd8fcb2', 'request_id': 'req-a0cf2d4f-965c-425c-8624-5be03f90430a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:16.437848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2873e572e58243079526008d5dd8fcb2', 'request_id': 'req-a0cf2d4f-965c-425c-8624-5be03f90430a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:16.648606 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2873e572e58243079526008d5dd8fcb2', 'request_id': 'req-a0cf2d4f-965c-425c-8624-5be03f90430a'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:16.681922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] The token cache is being invalidate because project 2873e572e58243079526008d5dd8fcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:16.681922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:16.681922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:16.681922 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1372/2760] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:16 2021] DELETE /identity/v3/projects/2873e572e58243079526008d5dd8fcb2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:16.682335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:16.682335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf665f-31e0-4b5d-9922-af1846393972 service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:16.732609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:16.733470 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:16.733755 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:16.734030 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] PATH_INFO: `/v3/users/ecf9a17e27914fca93b79ac3333b9525` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:16.735188 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf9a17e27914fca93b79ac3333b9525)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:16.737297 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:17.079768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf9a17e27914fca93b79ac3333b9525'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:17.092020 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf9a17e27914fca93b79ac3333b9525'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:17.282864 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf9a17e27914fca93b79ac3333b9525'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:17.314247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf9a17e27914fca93b79ac3333b9525'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:17.314247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-49950774-a2d1-4c48-9d51-1bf254d81ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf9a17e27914fca93b79ac3333b9525'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:17.314247 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1389/2761] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:16 2021] DELETE /identity/v3/users/ecf9a17e27914fca93b79ac3333b9525 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:17.867327 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:17.868854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:17.882359 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf2d4f-965c-425c-8624-5be03f90430a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:17.941963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:17.942830 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:17.943123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:17.943941 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] PATH_INFO: `/v3/projects/2d9c8d0474014197a40e3f3310298ef8` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:17.945165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c8d0474014197a40e3f3310298ef8)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:17.947117 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.083949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c8d0474014197a40e3f3310298ef8', 'request_id': 'req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:18.090253 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c8d0474014197a40e3f3310298ef8', 'request_id': 'req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:18.197198 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c8d0474014197a40e3f3310298ef8', 'request_id': 'req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:18.207847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] The token cache is being invalidate because project 2d9c8d0474014197a40e3f3310298ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:18.208135 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:18.208792 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-ceadf2a8-3923-4c2f-b06a-a5a0f6903824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:18.210322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1373/2762] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:17 2021] DELETE /identity/v3/projects/2d9c8d0474014197a40e3f3310298ef8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:18.215971 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.216486 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.216598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.234200 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:18.235411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:18.293370 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1390/2763] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:18.301559 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.301847 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.302123 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.320949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:18.322149 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:18.330107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1374/2764] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:18.334197 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.343936 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd838-8fc8-4703-a8d1-ed33d218dfc8 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.348507 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.349154 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.350166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.350479 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.351195 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:48:18.351502 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.353149 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.365928 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1391/2765] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:48:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:48:18.370390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.379453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46d393-2ad8-40cc-a1e4-a7a59b0a1b86 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.384082 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.384757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.385039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.385310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.385979 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.387994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.624310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1375/2766] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:18 2021] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:18.625824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.636189 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b1419-4571-4593-b299-6f1861f28e9e admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.692853 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.693558 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.693841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.694136 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.694818 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.696744 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.883517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1392/2767] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:18 2021] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:18.887763 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.897905 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e6aa-94f2-49f9-ad78-20bcd8339cb3 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.902612 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.903280 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.903567 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.903844 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.904609 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.906189 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.916571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1376/2768] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:18.920951 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.931764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046a079-cdc9-477e-bef9-c09a4506bc89 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.936371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.937024 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.937307 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.937578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.938285 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.939913 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d01b5-2938-4cb9-97b7-dfe263425944 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:18.950623 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1393/2769] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:18.954946 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:18.964865 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0df2b3-e438-4261-8e94-bcd71968e33b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:18.969407 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:18.970269 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:18.970549 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:18.970826 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] PATH_INFO: `/v3/projects/765418ec241342b29a7daeef29e42248/users/41447304d0bc4f2a95733519a1f0eaaa/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:18.985271 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=765418ec241342b29a7daeef29e42248, user_id=41447304d0bc4f2a95733519a1f0eaaa, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:18.987975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:19.174593 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1377/2770] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:18 2021] PUT /identity/v3/projects/765418ec241342b29a7daeef29e42248/users/41447304d0bc4f2a95733519a1f0eaaa/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:19.186293 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:19.186616 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:19.186932 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:19.213014 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] MFA Rules not processed for user `41447304d0bc4f2a95733519a1f0eaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:19.214215 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:19.276369 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1394/2771] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:19 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:19.287778 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:19.292901 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:19.343526 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f1739-36e8-48ca-9ac7-7368eb5cc34c admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:19.347165 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:19.347798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:19.348080 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:19.348387 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:19.358105 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:19.359728 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d26bef-52c7-47c7-973f-bf05589f3cc2 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:19.369298 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1378/2772] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:19 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:19.389231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:19.449350 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2ec4-c839-4359-b5c0-e2bb32b2cd0a None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:19.453859 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:19.454717 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:19.455000 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:19.455275 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] PATH_INFO: `/v3/users/41447304d0bc4f2a95733519a1f0eaaa` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:19.456488 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41447304d0bc4f2a95733519a1f0eaaa)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:19.458414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:19.821366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41447304d0bc4f2a95733519a1f0eaaa'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:19.832944 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41447304d0bc4f2a95733519a1f0eaaa'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:19.944978 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41447304d0bc4f2a95733519a1f0eaaa'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:19.945599 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41447304d0bc4f2a95733519a1f0eaaa'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:19.946207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41447304d0bc4f2a95733519a1f0eaaa'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:19.958347 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1395/2773] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:19 2021] DELETE /identity/v3/users/41447304d0bc4f2a95733519a1f0eaaa => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 03:48:19.962899 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:19.963386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:19.963506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:19.980963 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:19.985790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:20.039867 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1379/2774] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:48:20.049830 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:20.051225 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:20.106799 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd33d-3c84-4d45-b56f-dacad4a3d3e2 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:20.110344 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:20.110996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:20.111282 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:20.112029 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:20.121918 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:20.123352 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154d14-c5bd-4445-89e2-1b63dd9b38ff service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:20.132983 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1396/2775] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:20.615248 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:20.616710 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:20.636843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282e39-f53a-4541-9d12-7ed53e906feb None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:20.636843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:20.636843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:20.636843 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:20.637233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] PATH_INFO: `/v3/projects/765418ec241342b29a7daeef29e42248` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:20.637233 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765418ec241342b29a7daeef29e42248)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:20.638421 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:20.786217 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765418ec241342b29a7daeef29e42248', 'request_id': 'req-17d384ca-81d6-4e2c-94a7-9ba1a9244070'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:20.792301 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765418ec241342b29a7daeef29e42248', 'request_id': 'req-17d384ca-81d6-4e2c-94a7-9ba1a9244070'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:20.899813 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765418ec241342b29a7daeef29e42248', 'request_id': 'req-17d384ca-81d6-4e2c-94a7-9ba1a9244070'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:20.909975 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] The token cache is being invalidate because project 765418ec241342b29a7daeef29e42248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:20.912415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:20.912415 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-17d384ca-81d6-4e2c-94a7-9ba1a9244070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:20.912892 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1380/2776] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:20 2021] DELETE /identity/v3/projects/765418ec241342b29a7daeef29e42248 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:20.918490 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:20.918980 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:20.919129 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:20.936702 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:20.937933 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:20.993692 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1397/2777] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:21.001344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.001832 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.002039 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.019955 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:21.021748 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:21.029453 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1381/2778] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:21.033602 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.043649 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4810fb0-72bc-4776-84c2-494c37e99c3c None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.048346 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.048994 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.049278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.049589 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.050271 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:48:21.050580 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.052174 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.063232 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1398/2779] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:48:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:48:21.067450 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.076395 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd853e-d544-47f1-b5f6-fb84d5f90bee None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.081008 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.081657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.081943 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.082220 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.082916 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.085373 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.262024 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1382/2780] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:21 2021] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:21.266210 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.276594 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04af457-4fcd-4728-b69f-d0ad81da03ab admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.330436 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.331097 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.331389 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.331664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.332376 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.334814 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.448545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1399/2781] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:21 2021] POST /identity/v3/users => generated 280 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:21.452658 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.463386 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313399-3629-4243-accc-c54918f0a9f1 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.467958 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.468654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.468940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.469219 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.469984 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.471557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.482663 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1383/2782] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:21.486363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.496824 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd485-b9f1-492a-acd5-f8e53bef2770 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.501514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.502168 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.502454 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.502731 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.503438 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.505114 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee07c4-8239-4112-86b2-be4e511a9fb3 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.515180 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1400/2783] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:21.519727 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.530257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52071f8-20fb-4620-ab3d-6fe391013606 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.535019 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.535912 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.536221 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.536510 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] PATH_INFO: `/v3/projects/a0c21efd7ef943ac917e1c24a63d01ee/users/4dd00293ef99477799de12b8340d75e8/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.550616 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c21efd7ef943ac917e1c24a63d01ee, user_id=4dd00293ef99477799de12b8340d75e8, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.553270 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.659536 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1384/2784] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:21 2021] PUT /identity/v3/projects/a0c21efd7ef943ac917e1c24a63d01ee/users/4dd00293ef99477799de12b8340d75e8/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:21.669514 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.669809 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.670095 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.696517 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] MFA Rules not processed for user `4dd00293ef99477799de12b8340d75e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:21.697715 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:21.759320 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1401/2785] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:21 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:21.786141 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.787860 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:21.843385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2428f5-2da8-46f3-81d6-b8eae546e54d admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.847127 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.847771 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.848058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.848365 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.856749 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.865653 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17eeb8-8c3c-4953-a7f9-af4dff938613 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:21.867303 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1385/2786] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:21 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:21.881349 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:21.941682 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eca121-03ed-462a-81e8-e5f0646f0197 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:21.946916 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:21.947768 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:21.948049 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:21.948360 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] PATH_INFO: `/v3/users/4dd00293ef99477799de12b8340d75e8` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:21.949545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd00293ef99477799de12b8340d75e8)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:21.951445 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:22.194196 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd00293ef99477799de12b8340d75e8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:22.205782 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd00293ef99477799de12b8340d75e8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:22.288668 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd00293ef99477799de12b8340d75e8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:22.289308 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd00293ef99477799de12b8340d75e8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:22.289926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd00293ef99477799de12b8340d75e8'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:22.301865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1402/2787] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:21 2021] DELETE /identity/v3/users/4dd00293ef99477799de12b8340d75e8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:22.307094 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043c63-30ff-49a3-b609-066660491568 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:22.307598 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043c63-30ff-49a3-b609-066660491568 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:22.307705 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e043c63-30ff-49a3-b609-066660491568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:22.324311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-0e043c63-30ff-49a3-b609-066660491568 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:22.325539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0e043c63-30ff-49a3-b609-066660491568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:22.384623 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1386/2788] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:22.394559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:22.396042 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:22.451751 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf87534-34bd-4089-83e3-b69b92e0b3af admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:22.455571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:22.456248 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:22.456540 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:22.456822 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:22.465794 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:22.467220 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1e3b0-f2a6-47af-9446-f89f7dd72531 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:22.477353 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1403/2789] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:23.009939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e043c63-30ff-49a3-b609-066660491568 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.011331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0e043c63-30ff-49a3-b609-066660491568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:23.027588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e043c63-30ff-49a3-b609-066660491568 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.027588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.028495 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.028757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.029030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] PATH_INFO: `/v3/projects/a0c21efd7ef943ac917e1c24a63d01ee` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.030247 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c21efd7ef943ac917e1c24a63d01ee)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.032128 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.179682 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c21efd7ef943ac917e1c24a63d01ee', 'request_id': 'req-fef938ef-923c-4018-80f5-70a1ff570d79'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:23.185875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c21efd7ef943ac917e1c24a63d01ee', 'request_id': 'req-fef938ef-923c-4018-80f5-70a1ff570d79'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:23.297897 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c21efd7ef943ac917e1c24a63d01ee', 'request_id': 'req-fef938ef-923c-4018-80f5-70a1ff570d79'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:23.305849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] The token cache is being invalidate because project a0c21efd7ef943ac917e1c24a63d01ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:23.306146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:23.306785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-fef938ef-923c-4018-80f5-70a1ff570d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:23.308344 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1387/2790] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:23 2021] DELETE /identity/v3/projects/a0c21efd7ef943ac917e1c24a63d01ee => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:23.314559 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.315265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.315265 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.332671 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:23.333996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:23.390771 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1404/2791] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:48:23.399478 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.399840 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.400188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.418436 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:23.419648 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:23.428056 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1388/2792] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:23.432081 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.441841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85d18f-e7bf-4be3-8984-e126127c6e71 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.447382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.448075 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.448401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.448687 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] PATH_INFO: `/v3/domains` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.449414 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73155) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 03:48:23.449729 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.451925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.463765 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1405/2793] 10.222.0.21 () {58 vars in 1153 bytes} [Tue Aug 10 03:48:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 03:48:23.468331 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.477894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7886528-57a2-489f-81b2-761a53b25e89 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.482894 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.483546 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.483831 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.484107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] PATH_INFO: `/v3/projects` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.484906 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.486948 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.616153 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1389/2794] 10.222.0.21 () {60 vars in 1153 bytes} [Tue Aug 10 03:48:23 2021] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:23.620581 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.630719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32dd431-f67a-42f3-b301-e3f1371cd135 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.686078 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.686746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.687061 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.687335 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] PATH_INFO: `/v3/users` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.688010 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.689966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.809217 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1406/2795] 10.222.0.21 () {60 vars in 1144 bytes} [Tue Aug 10 03:48:23 2021] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 03:48:23.813133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.823031 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3710268-f3b2-4298-9a71-5f4dafc9a303 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.827527 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.828173 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.828486 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.828790 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] PATH_INFO: `/v3/roles` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.829498 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.831066 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.841146 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1390/2796] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:23.850237 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.861676 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c890-9084-4ac2-9b81-f5922dbd3374 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.868298 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.868934 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.869278 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.869557 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] PATH_INFO: `/v3/roles` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.870310 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.872231 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27a0e4-e710-4125-93db-98a7fc9c916a admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:23.886366 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1407/2797] 10.222.0.21 () {58 vars in 1122 bytes} [Tue Aug 10 03:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 03:48:23.887569 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:23.897501 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c7f25-131f-4e50-8e4b-55444412874a admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:23.902086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:23.902949 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:23.903232 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:23.903506 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] PATH_INFO: `/v3/projects/beeab61eb3a1434b9a2d7288a3b402e9/users/c7e30f65eebf4e13b6de1eae9d0a512c/roles/c0c74397018c4e10ae44afe610b4259b` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:23.918133 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beeab61eb3a1434b9a2d7288a3b402e9, user_id=c7e30f65eebf4e13b6de1eae9d0a512c, role_id=c0c74397018c4e10ae44afe610b4259b)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:23.924120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:24.100465 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1391/2798] 10.222.0.21 () {60 vars in 1483 bytes} [Tue Aug 10 03:48:23 2021] PUT /identity/v3/projects/beeab61eb3a1434b9a2d7288a3b402e9/users/c7e30f65eebf4e13b6de1eae9d0a512c/roles/c0c74397018c4e10ae44afe610b4259b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:24.113171 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:24.113464 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:24.113743 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:24.139605 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] MFA Rules not processed for user `c7e30f65eebf4e13b6de1eae9d0a512c`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:24.140837 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:24.204487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1408/2799] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:24 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:24.217257 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:24.218965 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:24.275236 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd861a3a-3493-42cb-b23e-4d06b769bdf5 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:24.279420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '412b07d25ead4bcdb8bf64c0bf8726b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:24.280058 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:24.280376 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:24.280654 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:24.290099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:24.291516 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977963-0e2c-4681-871a-f4a93f59ddac service glance] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:24.300200 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1392/2800] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:24 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:29.086883 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:29.088361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:29.150748 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff539-db0f-465b-a913-90d539c5ef58 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:29.155399 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:29.156300 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:29.156586 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:29.156865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] PATH_INFO: `/v3/users/0716d00cf19a49c2b8bbdfc8bec61501` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:29.158107 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0716d00cf19a49c2b8bbdfc8bec61501)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:29.160060 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:29.400536 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0716d00cf19a49c2b8bbdfc8bec61501'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:29.417974 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0716d00cf19a49c2b8bbdfc8bec61501'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:29.483169 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0716d00cf19a49c2b8bbdfc8bec61501'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:29.483785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0716d00cf19a49c2b8bbdfc8bec61501'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:29.484424 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0716d00cf19a49c2b8bbdfc8bec61501'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:29.497315 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1409/2801] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:29 2021] DELETE /identity/v3/users/0716d00cf19a49c2b8bbdfc8bec61501 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:29.501998 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] REQUEST_METHOD: `POST` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:29.502848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:29.502848 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:29.519632 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.auth.core [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73156) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:29.520875 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:29.579401 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1393/2802] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:29.590034 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:29.591525 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:29.651102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750b207-56cb-4b78-991b-b6cf1cc7bdaa admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:29.654896 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:29.655552 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:29.655841 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:29.656119 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:29.665419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:29.667062 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba837-f573-4342-b691-9686e8ffb0b8 service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:29.676752 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1410/2803] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:30.220255 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:30.221702 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:30.234420 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bcb77-d70f-4478-9568-13230e99c403 None None] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:30.240798 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:30.241625 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:30.241911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:30.242209 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] PATH_INFO: `/v3/projects/3f376e27cf214f6ba57236aed1a897be` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:30.243765 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f376e27cf214f6ba57236aed1a897be)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:30.245980 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:30.449507 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f376e27cf214f6ba57236aed1a897be', 'request_id': 'req-f98a1f34-69f8-4843-93e6-cac2cf3c809b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:30.455701 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f376e27cf214f6ba57236aed1a897be', 'request_id': 'req-f98a1f34-69f8-4843-93e6-cac2cf3c809b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:30.545322 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f376e27cf214f6ba57236aed1a897be', 'request_id': 'req-f98a1f34-69f8-4843-93e6-cac2cf3c809b'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:30.557070 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] The token cache is being invalidate because project 3f376e27cf214f6ba57236aed1a897be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73156) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:30.557346 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:30.557966 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:30.559530 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1394/2804] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:30 2021] DELETE /identity/v3/projects/3f376e27cf214f6ba57236aed1a897be => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:34.730495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33190daf-3b47-464a-86b0-7efc7fafb6de None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:34.730991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33190daf-3b47-464a-86b0-7efc7fafb6de None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:34.731092 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33190daf-3b47-464a-86b0-7efc7fafb6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:34.747911 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-33190daf-3b47-464a-86b0-7efc7fafb6de None None] MFA Rules not processed for user `8b443000b4ae4082ac0da4f090ede3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:34.749145 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-33190daf-3b47-464a-86b0-7efc7fafb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:34.806326 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1411/2805] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:34 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:54.899940 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:54.901645 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:54.963807 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a1f34-69f8-4843-93e6-cac2cf3c809b admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:54.968254 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:54.969108 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:54.969392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:54.969669 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] PATH_INFO: `/v3/users/c7e30f65eebf4e13b6de1eae9d0a512c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:54.970849 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e30f65eebf4e13b6de1eae9d0a512c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:54.972886 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:55.284000 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e30f65eebf4e13b6de1eae9d0a512c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:55.284608 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e30f65eebf4e13b6de1eae9d0a512c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:55.285211 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e30f65eebf4e13b6de1eae9d0a512c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:55.291862 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e30f65eebf4e13b6de1eae9d0a512c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:55.303263 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e30f65eebf4e13b6de1eae9d0a512c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:55.408145 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1395/2806] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:48:54 2021] DELETE /identity/v3/users/c7e30f65eebf4e13b6de1eae9d0a512c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:48:55.412842 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:55.413371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:55.413371 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:55.430829 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] MFA Rules not processed for user `f29509a114484baab53625cc3aa60565`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:48:55.432073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:55.488596 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1412/2807] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:48:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 03:48:55.498633 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:55.500004 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:55.555911 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11e0f9-ca58-4ec6-93ae-a8e3c24aacef admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:55.559390 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:55.560033 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:55.560385 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:55.560667 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:55.569795 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:55.571216 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:55.580621 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1396/2808] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:48:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:48:56.049023 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:48:56.050609 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:48:56.064148 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ffcc3-0fd3-4bd5-9406-69e3206c9864 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:48:56.070066 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:48:56.070927 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:48:56.071207 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:48:56.071578 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] PATH_INFO: `/v3/projects/beeab61eb3a1434b9a2d7288a3b402e9` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:48:56.072672 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beeab61eb3a1434b9a2d7288a3b402e9)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:48:56.074761 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:48:56.230204 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beeab61eb3a1434b9a2d7288a3b402e9', 'request_id': 'req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:56.235664 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beeab61eb3a1434b9a2d7288a3b402e9', 'request_id': 'req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:56.242292 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beeab61eb3a1434b9a2d7288a3b402e9', 'request_id': 'req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:56.338135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] The token cache is being invalidate because project beeab61eb3a1434b9a2d7288a3b402e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:48:56.339544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:56.339544 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-1d3bffbc-3f69-4c9a-aa05-298fe0a73e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:48:56.341073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1413/2809] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:48:56 2021] DELETE /identity/v3/projects/beeab61eb3a1434b9a2d7288a3b402e9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:50:31.813268 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:31.822311 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e706460-bbb9-43af-abb1-15817e9a8801 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:31.869794 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:31.870434 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:31.870715 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:31.870989 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:31.872746 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:31.881681 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:31.883112 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:31.890968 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1397/2810] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:50:36.981440 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] REQUEST_METHOD: `POST` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:36.981929 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:36.982040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:36.999734 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.auth.core [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] MFA Rules not processed for user `8b443000b4ae4082ac0da4f090ede3b7`. Rule list: `[]` (Enabled: `True`). {{(pid=73155) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 03:50:37.000953 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:37.051827 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1414/2811] 10.222.0.21 () {58 vars in 958 bytes} [Tue Aug 10 03:50:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 03:50:37.085602 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:37.086997 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:37.142099 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d515-0566-4abd-a36c-d7850c5d9745 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:37.149074 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175949d4ebc945cdb0b0a43c8b223f16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:37.149712 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:37.149994 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:37.150273 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:37.152069 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:37.219595 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:37.221030 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:37.232884 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1398/2812] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:50:37.511865 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:37.513304 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:37.524966 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f8ccf-dac9-476c-a321-0c714f335303 None None] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:37.528555 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:37.529186 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:37.529469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:37.529746 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:37.531429 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:37.540788 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:37.542212 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:37.550663 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1415/2813] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:50:38.815328 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:38.816785 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.830524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784cffcb-c543-483c-8ede-4aec01be4832 service cinder] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:38.833411 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:38.834785 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.836615 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:38.837279 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:38.837571 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:38.837854 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:38.839642 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.851044 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:38.853077 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:38.862585 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1399/2814] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:38 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:50:38.898524 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:38.900159 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.902845 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf7730-7785-4904-bdeb-527dccb9b31d service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:38.907975 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:38.908597 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:38.909401 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:38.909675 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:38.911494 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.912176 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb93644-6a76-411c-acf7-74136c90ed0c service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:38.915761 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:38.916539 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:38.916823 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:38.917095 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:38.918816 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:38.923166 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:38.925394 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:38.932635 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:38.934055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:38.935764 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1416/2815] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:38 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:50:38.946086 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1400/2816] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:50:39.036319 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:39.037862 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:39.050926 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d4011-53bb-48ef-8bbd-74db789c3a83 service placement] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:39.056142 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:39.056815 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:39.057102 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:39.057382 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:39.059121 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:39.070925 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:39.072548 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:39.083028 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1417/2817] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:39 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:50:43.038336 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:43.050588 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efdabb-1580-4a78-aadb-2fd79d445a31 service neutron] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:43.057160 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:43.057909 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:43.058201 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:43.058483 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:43.060363 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:43.073993 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:43.083310 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:43.087557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1401/2818] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:43 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:50:53.325739 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:50:53.339040 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005315db-aac1-462e-a05b-4449d9eaba56 service placement] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:50:53.344646 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72464249c58f4f278dbea091c17c192a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:50:53.345283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:50:53.345571 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:50:53.346545 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:50:53.348361 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:50:53.361130 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:50:53.362718 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:50:53.380153 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1418/2819] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:50:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:52:29.969104 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:30.030152 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c35391-15d9-4ce9-ba2f-d84fe7fe90df service nova] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:30.035881 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:30.036557 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:30.036842 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:30.037285 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:30.040212 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:52:30.074757 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:30.076392 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:30.092877 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1402/2820] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:52:29 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 03:52:41.768240 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:41.805306 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475111c-bae9-4ae8-86a2-0c2ddbd0216e service nova] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:41.809002 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '128aae7c4c7b4d2a9bfc0eb65e1c5734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:41.809644 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] REQUEST_METHOD: `GET` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:41.809939 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:41.810203 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:41.811957 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:52:41.893598 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:41.894942 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:41.915562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1419/2821] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:52:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 03:52:49.335858 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:49.337554 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:52:49.353409 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97342d-305d-4665-af20-5e42bbe271ec service placement] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:49.359752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:49.359752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:49.359752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:49.359752 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] PATH_INFO: `/v3/users/8b443000b4ae4082ac0da4f090ede3b7` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:49.361454 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b443000b4ae4082ac0da4f090ede3b7)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:49.363341 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:49.667048 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b443000b4ae4082ac0da4f090ede3b7'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:49.667690 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b443000b4ae4082ac0da4f090ede3b7'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:49.668329 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b443000b4ae4082ac0da4f090ede3b7'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:49.675777 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b443000b4ae4082ac0da4f090ede3b7'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:49.688107 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b443000b4ae4082ac0da4f090ede3b7'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:49.785444 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1403/2822] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:52:49 2021] DELETE /identity/v3/users/8b443000b4ae4082ac0da4f090ede3b7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:52:50.033562 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:50.043101 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f64c7c-be58-4b31-9ff6-d718e9c938fb service neutron] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:50.100860 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:50.101721 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:50.102006 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:50.102283 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] PATH_INFO: `/v3/projects/640c843532144cd4ac804d005116e62c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:50.103469 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640c843532144cd4ac804d005116e62c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:50.105449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:50.236991 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640c843532144cd4ac804d005116e62c', 'request_id': 'req-ee93cc50-2f66-45d6-b44f-aee64c800b63'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.242363 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640c843532144cd4ac804d005116e62c', 'request_id': 'req-ee93cc50-2f66-45d6-b44f-aee64c800b63'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.248495 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640c843532144cd4ac804d005116e62c', 'request_id': 'req-ee93cc50-2f66-45d6-b44f-aee64c800b63'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.333073 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] The token cache is being invalidate because project 640c843532144cd4ac804d005116e62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:52:50.333364 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.334135 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.335877 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1420/2823] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:52:50 2021] DELETE /identity/v3/projects/640c843532144cd4ac804d005116e62c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:52:50.340471 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:50.344814 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:52:50.356076 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f720b30-c108-469f-81c2-956fcdbaa716 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:50.413144 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:50.414188 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:50.414473 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:50.414780 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] PATH_INFO: `/v3/users/7f46a2ca9a794d039410028fd5c4bc8c` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:50.415974 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f46a2ca9a794d039410028fd5c4bc8c)` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:50.418055 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:50.571097 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f46a2ca9a794d039410028fd5c4bc8c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.571661 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f46a2ca9a794d039410028fd5c4bc8c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.572321 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f46a2ca9a794d039410028fd5c4bc8c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.579035 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f46a2ca9a794d039410028fd5c4bc8c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.590576 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.notifications [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f46a2ca9a794d039410028fd5c4bc8c'} {{(pid=73156) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:50.704824 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1404/2824] 10.222.0.21 () {58 vars in 1224 bytes} [Tue Aug 10 03:52:50 2021] DELETE /identity/v3/users/7f46a2ca9a794d039410028fd5c4bc8c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:52:50.969303 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Authenticating user token {{(pid=73155) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:52:50.971419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.fernet_utils [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73155) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:52:50.984941 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93cc50-2f66-45d6-b44f-aee64c800b63 admin admin] Validating token access rules against request {{(pid=73155) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:52:51.045487 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f29509a114484baab53625cc3aa60565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd847766cb8f7495b8c5c2a2d48910f07', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73155) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:52:51.046435 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:52:51.046719 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:52:51.046996 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] PATH_INFO: `/v3/projects/8a90442f398e4eed98b7db983952458c` {{(pid=73155) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:52:51.048405 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a90442f398e4eed98b7db983952458c)` {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:52:51.050419 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] RBAC: Authorization granted {{(pid=73155) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:52:51.139568 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a90442f398e4eed98b7db983952458c', 'request_id': 'req-ba473f64-39ba-4816-bc21-12a87e8a5556'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:51.145383 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a90442f398e4eed98b7db983952458c', 'request_id': 'req-ba473f64-39ba-4816-bc21-12a87e8a5556'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:51.151449 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a90442f398e4eed98b7db983952458c', 'request_id': 'req-ba473f64-39ba-4816-bc21-12a87e8a5556'} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:51.231318 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] The token cache is being invalidate because project 8a90442f398e4eed98b7db983952458c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73155) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 03:52:51.231626 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:51.232484 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: DEBUG keystone.notifications [None req-ba473f64-39ba-4816-bc21-12a87e8a5556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73155) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 03:52:51.234635 dv-cinder-782390-8-iscsi devstack@keystone.service[73155]: [pid: 73155|app: 0|req: 1421/2825] 10.222.0.21 () {58 vars in 1233 bytes} [Tue Aug 10 03:52:50 2021] DELETE /identity/v3/projects/8a90442f398e4eed98b7db983952458c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 03:57:33.855636 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Authenticating user token {{(pid=73156) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 03:57:33.857120 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:57:33.925836 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3505f6-d6f8-4998-a86f-d0f1975283d8 admin admin] Validating token access rules against request {{(pid=73156) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 03:57:33.986657 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fbee68034fe479e8e77af166c12f778', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd932e1eb838d45edb79d362f44c9e53b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73156) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 03:57:33.987313 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] REQUEST_METHOD: `GET` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 03:57:33.987619 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] SCRIPT_NAME: `/identity` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 03:57:33.987893 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73156) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 03:57:33.989781 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.fernet_utils [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73156) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 03:57:34.002283 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 03:57:34.003939 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053d65-ac99-4104-aee1-da0d29675da4 service placement] RBAC: Authorization granted {{(pid=73156) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 03:57:34.015073 dv-cinder-782390-8-iscsi devstack@keystone.service[73156]: [pid: 73156|app: 0|req: 1405/2826] 10.222.0.21 () {60 vars in 1366 bytes} [Tue Aug 10 03:57:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)